Jun 23 13:46:51 devstack cinder-volume[82659]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 13:46:51 devstack cinder-volume[82659]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:46:51 devstack cinder-volume[82659]: we strongly recommend against using it for new projects. Jun 23 13:46:51 devstack cinder-volume[82659]: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:46:51 devstack cinder-volume[82659]: framework. For more detail see Jun 23 13:46:51 devstack cinder-volume[82659]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:46:51 devstack cinder-volume[82659]: import eventlet # noqa Jun 23 13:46:54 devstack cinder-volume[82659]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:46:54 devstack cinder-volume[82659]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:46:54 devstack cinder-volume[82659]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:46:55 devstack cinder-volume[82659]: INFO dbcounter [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Registered counter for database cinder Jun 23 13:46:55 devstack cinder-volume[82659]: DEBUG oslo_db.sqlalchemy.engines [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:55 devstack cinder-volume[82659]: DEBUG dbcounter [-] [82659] Writer thread running {{(pid=82659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:46:55 devstack cinder-volume[82659]: INFO cinder.rpc [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 13:46:55 devstack cinder-volume[82659]: INFO cinder.rpc [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 13:46:55 devstack cinder-volume[82659]: DEBUG oslo_db.sqlalchemy.engines [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:55 devstack cinder-volume[82659]: INFO cinder.volume.manager [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Determined volume DB was empty at startup. Jun 23 13:46:55 devstack cinder-volume[82659]: DEBUG cinder.volume.manager [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82659) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 13:46:55 devstack cinder-volume[82659]: INFO cinder.volume.manager [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 13:46:55 devstack cinder-volume[82659]: WARNING stevedore.named [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:46:55 devstack cinder-volume[82659]: WARNING castellan.key_manager [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:46:55 devstack cinder-volume[82659]: WARNING cinder.keymgr.conf_key_mgr [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:46:55 devstack cinder-volume[82659]: DEBUG cinder.volume.drivers.lvm [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82659) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 13:46:55 devstack cinder-volume[82659]: DEBUG oslo_concurrency.processutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_concurrency.processutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.608s {{(pid=82659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_db.sqlalchemy.engines [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:56 devstack cinder-volume[82659]: INFO cinder.rpc [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 13:46:56 devstack cinder-volume[82659]: INFO cinder.rpc [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 13:46:56 devstack cinder-volume[82659]: WARNING stevedore.named [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:46:56 devstack cinder-volume[82659]: WARNING castellan.key_manager [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:46:56 devstack cinder-volume[82659]: INFO cinder.volume.manager [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_db.sqlalchemy.engines [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:56 devstack cinder-volume[82659]: INFO oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Starting 1 workers Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Started child 82828 {{(pid=82659) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Full set of CONF: {{(pid=82659) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] ******************************************************************************** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Configuration options gathered from: {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] ================================================================================ {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] allow_availability_zone_fallback = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] allow_compression_on_image_upload = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] allowed_direct_url_schemes = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] api_rate_limit = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] auth_strategy = keystone {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] az_cache_duration = 3600 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_availability_zone = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_host = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_stats_polling_interval = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backup_api_class = cinder.backup.api.API {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backup_name_template = backup-%s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backup_use_same_host = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backup_use_temp_snapshot = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] chap_password = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] chap_username = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82828]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_internal_tenant_project_id = 61e0210faaaf4182a8cf801c3abc2970 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_internal_tenant_user_id = 6a311fce0b3a462baa2a1653e16c89c8 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cloned_volume_same_az = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cluster = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] compression_format = gzip {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] compute_api_class = cinder.compute.nova.API {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] config_dir = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] config_source = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] control_exchange = openstack {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] debug = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] default_availability_zone = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] default_group_type = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] default_volume_type = lvmdriver-1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] disk_geometry = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] driver_client_cert = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] driver_client_cert_key = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] driver_data_namespace = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] driver_ssl_cert_path = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] driver_ssl_cert_verify = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] driver_use_ssl = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] enable_force_upload = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] enable_new_services = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] enable_unsupported_driver = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] enforce_multipath_for_image_xfer = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] filter_function = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_api_insecure = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_api_ssl_compression = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_ca_certificates_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_catalog_info = image:glance:publicURL {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_num_retries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance_request_timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] goodness_function = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] graceful_shutdown_timeout = 5 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] group_api_class = cinder.group.api.API {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] host = devstack {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_compress_on_upload = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_conversion_address_space_limit = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_conversion_cpu_limit = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_conversion_disable = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_upload_use_cinder_backend = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_upload_use_internal_tenant = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_volume_cache_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_volume_cache_max_count = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] image_volume_cache_max_size_gb = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] init_host_max_objects_retrieval = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] instance_format = [instance: %(uuid)s] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] iscsi_target_flags = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] iscsi_write_cache = on {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] iser_helper = tgtadm {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] iser_ip_address = 192.168.122.163 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] iser_port = 3260 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_color = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_config_append = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_dir = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_options = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_rotate_interval = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_rotate_interval_type = days {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] log_rotation_type = none {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] max_age = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] max_logfile_count = 30 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] max_logfile_size_mb = 200 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] max_over_subscription_ratio = 20.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] message_reap_interval = 86400 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] message_ttl = 2592000 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] migration_create_volume_timeout_secs = 300 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] monkey_patch = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] monkey_patch_modules = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] my_ip = 192.168.122.163 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] no_snapshot_gb_quota = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] num_iser_scan_tries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] num_shell_tries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] num_volume_device_scan_tries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] nvmeof_conn_info_version = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] nvmet_ns_id = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] nvmet_port_id = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_max_limit = 1000 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_volume_ext_list = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_volume_listen_port = 8776 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_volume_use_ssl = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] osapi_volume_workers = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] per_volume_size_limit = -1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] periodic_fuzzy_delay = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] periodic_interval = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] public_endpoint = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] publish_errors = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_backup_gigabytes = 1000 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_backups = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_gigabytes = 1000 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_groups = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_snapshots = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] quota_volumes = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] rate_limit_burst = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] rate_limit_except_level = CRITICAL {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] rate_limit_interval = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] reinit_driver_count = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] replication_device = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] report_discard_supported = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] report_interval = 120 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] reservation_clean_interval = 86400 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] reservation_expire = 86400 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] reserved_image_namespaces = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] reserved_percentage = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] rpc_response_timeout = 120 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] run_external_periodic_tasks = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] scst_target_driver = iscsi {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] scst_target_iqn_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_down_time = 720 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] shell_completion = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] snapshot_name_template = snapshot-%s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] snapshot_same_host = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] split_loggers = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] state_path = /opt/stack/data/cinder {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] storage_availability_zone = nova {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] storage_protocol = iSCSI {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] syslog_log_facility = LOG_USER {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] target_helper = lioadm {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] target_ip_address = 192.168.122.163 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] target_port = 3260 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] target_protocol = iscsi {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] target_secondary_ip_addresses = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] trace_flags = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] transport_url = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] until_refresh = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_chap_auth = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_default_quota_class = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_journal = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_json = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_multipath_for_image_xfer = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_stderr = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] use_syslog = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] verify_glance_signatures = enabled {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_api_class = cinder.volume.api.API {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_backend_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_clear = zero {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_clear_ionice = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_clear_size = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_copy_bps_limit = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_dd_blocksize = 1M {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_name_template = volume-%s {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_service_inithost_offload = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volume_usage_audit_period = month {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] zoning_mode = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_concurrency.disable_process_locking = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.auth_section = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.auth_type = password {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.auth_version = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.cache = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.include_service_catalog = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.insecure = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.interface = public {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_password = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcache_username = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.region_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.service_type = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.backend = dogpile.cache.null {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.backend_argument = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.backend_expiration_time = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.config_prefix = cache.oslo {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.debug_cache_backend = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.enable_retry_client = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.enable_socket_keepalive = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: INFO cinder.volume.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.expiration_time = 600 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.hashclient_retry_attempts = 2 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_dead_retry = 300 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_pool_maxsize = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_sasl_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.password = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.proxies = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.redis_db = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.redis_server = localhost:6379 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.retry_attempts = 2 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.retry_delay = 0.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.socket_keepalive_count = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.socket_keepalive_idle = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.socket_keepalive_interval = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.socket_timeout = 1.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.tls_allowed_ciphers = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.tls_cafile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.tls_certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.tls_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.tls_keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cache.username = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] coordination.backend_url = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.asyncio_connection = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.asyncio_slave_connection = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.backend = sqlalchemy {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.connection = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.connection_debug = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.connection_parameters = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.connection_recycle_time = 3600 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.connection_trace = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.db_inc_retry_interval = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.db_max_retries = 20 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.db_max_retry_interval = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.db_retry_interval = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.max_overflow = 50 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.max_pool_size = 5 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.max_retries = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.mysql_wsrep_sync_wait = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.pool_timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.retry_interval = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.slave_connection = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.sqlite_synchronous = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.synchronous_reader = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] database.use_db_reconnect = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.connection_string = messaging:// {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.es_doc_type = notification {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.es_scroll_size = 10000 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.es_scroll_time = 2m {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.filter_error_trace = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.hmac_keys = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.sentinel_service_name = mymaster {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.socket_timeout = 0.1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.trace_requests = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler.trace_sqlalchemy = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler_jaeger.process_tags = {} {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler_jaeger.service_name_prefix = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] profiler_otlp.service_name_prefix = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.enforce_new_defaults = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: WARNING oslo_config.cfg [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.enforce_scope = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.policy_default_rule = default {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.policy_file = policy.yaml {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.group = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.helper_command = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] privsep_osbrick.user = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.group = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.helper_command = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] cinder_sys_admin.user = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.auth_section = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.auth_type = password {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.cafile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.collect_timing = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.insecure = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.send_service_user_token = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.split_loggers = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] service_user.timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.auth_section = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.auth_type = password {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.collect_timing = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.insecure = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.region_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.split_loggers = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] glance.timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.backend_availability_zone = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.chap_password = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.chap_username = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack sudo[82832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.disk_geometry = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.driver_client_cert = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.driver_client_cert_key = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.driver_data_namespace = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack sudo[82832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.driver_use_ssl = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.extra_capabilities = {} {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.filter_function = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.goodness_function = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.iscsi_target_flags = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.iscsi_write_cache = on {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.iser_helper = tgtadm {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.iser_port = 3260 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.lvm_share_target = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.lvm_type = auto {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.num_shell_tries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.replication_device = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.report_discard_supported = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.reserved_percentage = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.target_helper = tgtadm {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.target_port = 3260 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.target_protocol = iscsi {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.trace_flags = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.unique_fqdn_network = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.use_chap_auth = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_backend_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_clear = zero {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_clear_ionice = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_clear_size = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_reports.file_event_handler = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_reports.log_dir = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.backend_host = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.chap_password = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.chap_username = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.disk_geometry = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.driver_client_cert = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.extra_capabilities = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.filter_function = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.goodness_function = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.iser_helper = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.iser_ip_address = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.iser_port = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.lvm_share_target = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.lvm_type = auto {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.num_shell_tries = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.replication_device = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.report_discard_supported = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.reserved_percentage = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.scst_target_driver = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.storage_protocol = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.target_helper = lioadm {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.target_ip_address = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.target_port = 3260 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.trace_flags = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.use_chap_auth = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_clear = zero {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_clear_size = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] lvmdriver-1.volumes_dir = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_notifications.driver = [] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_notifications.retry = -1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] key_manager.fixed_key = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.barbican_api_version = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.barbican_endpoint = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.barbican_endpoint_type = public {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.barbican_region_name = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.cafile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.collect_timing = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.insecure = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:56 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.number_of_retries = 60 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.retry_delay = 1 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.send_service_user_token = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.split_loggers = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.verify_ssl = True {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican.verify_ssl_path = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.auth_section = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.auth_type = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.cafile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.certfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.collect_timing = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.insecure = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.keyfile = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.split_loggers = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] barbican_service_user.timeout = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.approle_role_id = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.approle_secret_id = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.kv_mountpoint = secret {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.kv_path = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.kv_version = 2 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.namespace = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.root_token_id = **** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.ssl_ca_crt_file = None {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.timeout = 60.0 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.use_ssl = False {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:57 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] ******************************************************************************** {{(pid=82659) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 13:46:57 devstack sudo[82832]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:57 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:57 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:57 devstack sudo[82837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:57 devstack sudo[82837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:58 devstack sudo[82837]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:58 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.729s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:58 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:46:58 devstack cinder-volume[82828]: INFO cinder.brick.local_dev.lvm [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 13:46:58 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:58 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:58 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:58 devstack sudo[83135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:58 devstack sudo[83135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:59 devstack sudo[83135]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:59 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:59 devstack cinder-volume[82828]: DEBUG cinder.brick.local_dev.lvm [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82828) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 13:46:59 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:59 devstack sudo[83371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:59 devstack sudo[83371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:00 devstack sudo[83371]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:00 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.350s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:00 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:00 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:00 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:00 devstack sudo[83594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:00 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:01 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:01 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:01 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:01 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:01 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:01 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 13:47:01 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:01 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:01 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.738s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:01 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:01 devstack sudo[83618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:47:01 devstack sudo[83618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:02 devstack sudo[83618]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:02 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.932s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:02 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:02 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:47:02 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:03 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:03 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.916s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:03 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:03 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:03 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:04 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:04 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.740s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:04 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:04 devstack sudo[83651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:04 devstack sudo[83651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:05 devstack sudo[83651]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.687s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:05 devstack sudo[83655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:05 devstack sudo[83655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:05 devstack sudo[83655]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:05 devstack cinder-volume[82828]: INFO cinder.volume.drivers.lvm [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:05 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:05 devstack sudo[83665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:05 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:06 devstack cinder-volume[82659]: DEBUG dbcounter [-] [82659] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:47:06 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:06 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.814s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:06 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:47:06 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:06 devstack sudo[83781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:47:06 devstack sudo[83781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:07 devstack sudo[83781]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:07 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:07 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:07 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:07 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:08 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:08 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:08 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:08 devstack sudo[83926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:08 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:08 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:08 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:08 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:08 devstack sudo[83929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:08 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:09 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:09 devstack cinder-volume[82828]: INFO cinder.volume.driver [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG cinder.volume.driver [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82828) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG oslo_db.sqlalchemy.engines [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writer thread running {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG cinder.db.api [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Building query based on filter {{(pid=82828) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG cinder.image.image_utils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82828) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 13:47:09 devstack cinder-volume[82828]: INFO cinder.keymgr.migration [None req-cc42434b-bdf9-44bb-89bc-135809204209 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:47:09 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:09 devstack sudo[83937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:47:09 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:10 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:10 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:10 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:10 devstack sudo[83940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:10 devstack sudo[83940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:10 devstack sudo[83940]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:10 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:10 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:10 devstack sudo[83943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:10 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:11 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:11 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:11 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:11 devstack sudo[83947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:11 devstack sudo[83947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:12 devstack sudo[83947]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG cinder.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Notifying Schedulers of capabilities ... {{(pid=82828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:47:12 devstack cinder-volume[82828]: INFO cinder.volume.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Driver initialization completed successfully. Jun 23 13:47:12 devstack cinder-volume[82828]: INFO cinder.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Initiating service 2 cleanup Jun 23 13:47:12 devstack cinder-volume[82828]: INFO cinder.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Service 2 cleanup completed. Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG cinder.service [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Creating RPC server for service cinder-volume {{(pid=82828) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG cinder.service [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82828) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 13:47:12 devstack cinder-volume[82828]: INFO cinder.volume.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:12 devstack sudo[83950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:47:12 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:12 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:12 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:12 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:12 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:13 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:13 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:13 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:13 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:13 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:14 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:14 devstack sudo[84018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:14 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:14 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:14 devstack cinder-volume[82828]: INFO cinder.volume.manager [None req-6d74ca90-2522-4d73-8c0d-4c1b3774b570 None None] Driver post RPC initialization completed successfully. Jun 23 13:47:22 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writing DB stats cinder:SELECT=4 {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:47:24 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:48:14 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:48:14 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:48:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:14 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:48:14 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:15 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:15 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:48:15 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:16 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:16 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:48:16 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:16 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:16 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:48:16 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:17 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:17 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:17 devstack cinder-volume[82828]: DEBUG cinder.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Notifying Schedulers of capabilities ... {{(pid=82828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:48:17 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager._thread_info {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:48:17 devstack cinder-volume[82828]: DEBUG cinder.volume.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] thread count: 6 {{(pid=82828) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:48:17 devstack cinder-volume[82828]: DEBUG cinder.volume.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] thread info: [<_MainThread(MainThread, started 140595816439936)>, , , , , ] {{(pid=82828) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:49:14 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:49:14 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:49:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:14 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:49:14 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:15 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:15 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:49:15 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:16 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:16 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:49:16 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:16 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:16 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:49:16 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:17 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:17 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:17 devstack cinder-volume[82828]: DEBUG cinder.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Notifying Schedulers of capabilities ... {{(pid=82828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:49:24 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writing DB stats cinder:SELECT=1 {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:49:24 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writing DB stats cinder:UPDATE=1 {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:50:14 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:50:14 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:50:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:14 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:50:14 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:15 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:15 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:50:15 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:16 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:16 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:50:16 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:16 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:17 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:50:17 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:17 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:17 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:17 devstack cinder-volume[82828]: DEBUG cinder.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Notifying Schedulers of capabilities ... {{(pid=82828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:50:17 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager._thread_info {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:50:17 devstack cinder-volume[82828]: DEBUG cinder.volume.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] thread count: 6 {{(pid=82828) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:50:17 devstack cinder-volume[82828]: DEBUG cinder.volume.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] thread info: [<_MainThread(MainThread, started 140595816439936)>, , , , , ] {{(pid=82828) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:51:14 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:51:14 devstack cinder-volume[82828]: DEBUG cinder.volume.drivers.lvm [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Updating volume stats {{(pid=82828) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:51:14 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:14 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:51:14 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:15 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:15 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:15 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:51:15 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:16 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:16 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:51:16 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:16 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:16 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:16 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:51:16 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:17 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:17 devstack cinder-volume[82828]: DEBUG oslo_concurrency.processutils [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82828) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:17 devstack cinder-volume[82828]: DEBUG cinder.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Notifying Schedulers of capabilities ... {{(pid=82828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:51:17 devstack cinder-volume[82828]: DEBUG oslo_service.periodic_task [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] Running periodic task VolumeManager._thread_info {{(pid=82828) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:51:17 devstack cinder-volume[82828]: DEBUG cinder.volume.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] thread count: 6 {{(pid=82828) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:51:17 devstack cinder-volume[82828]: DEBUG cinder.volume.manager [None req-1fa79500-adb7-4bc1-a78b-70e04351d52f None None] thread info: [<_MainThread(MainThread, started 140595816439936)>, , , , , ] {{(pid=82828) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:51:24 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writing DB stats cinder:SELECT=1 {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:51:24 devstack cinder-volume[82828]: DEBUG dbcounter [-] [82828] Writing DB stats cinder:UPDATE=1 {{(pid=82828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:51:58 devstack cinder-volume[82659]: INFO oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Caught SIGTERM, stopping children Jun 23 13:51:58 devstack cinder-volume[82659]: DEBUG oslo_concurrency.lockutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Acquiring lock "singleton_lock" {{(pid=82659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:51:58 devstack cinder-volume[82659]: DEBUG oslo_concurrency.lockutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Acquired lock "singleton_lock" {{(pid=82659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:51:58 devstack cinder-volume[82659]: DEBUG oslo_concurrency.lockutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Releasing lock "singleton_lock" {{(pid=82659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:51:58 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Stop services. {{(pid=82659) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 13:51:58 devstack cinder-volume[82659]: DEBUG oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Killing children. {{(pid=82659) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 13:51:58 devstack cinder-volume[82659]: INFO oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Waiting on 1 children to exit Jun 23 13:52:02 devstack cinder-volume[82828]: DEBUG oslo_concurrency.lockutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Acquiring lock "singleton_lock" {{(pid=82828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:02 devstack cinder-volume[82828]: DEBUG oslo_concurrency.lockutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Acquired lock "singleton_lock" {{(pid=82828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:02 devstack cinder-volume[82828]: DEBUG oslo_concurrency.lockutils [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Releasing lock "singleton_lock" {{(pid=82828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:02 devstack cinder-volume[82828]: WARNING amqp [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:52:02 devstack cinder-volume[82828]: WARNING amqp [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:52:02 devstack cinder-volume[82659]: INFO oslo_service.backend._eventlet.service [None req-f390b51e-dd4f-4c5b-801d-d25356887ce4 None None] Child 82828 exited with status 0 Jun 23 13:52:02 devstack cinder-volume[92923]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 13:52:02 devstack cinder-volume[92923]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:52:02 devstack cinder-volume[92923]: we strongly recommend against using it for new projects. Jun 23 13:52:02 devstack cinder-volume[92923]: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:52:02 devstack cinder-volume[92923]: framework. For more detail see Jun 23 13:52:02 devstack cinder-volume[92923]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:52:02 devstack cinder-volume[92923]: import eventlet # noqa Jun 23 13:52:04 devstack cinder-volume[92923]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92923) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:04 devstack cinder-volume[92923]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92923) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:04 devstack cinder-volume[92923]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92923) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:05 devstack cinder-volume[92923]: INFO dbcounter [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Registered counter for database cinder Jun 23 13:52:05 devstack cinder-volume[92923]: DEBUG oslo_db.sqlalchemy.engines [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92923) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:05 devstack cinder-volume[92923]: DEBUG dbcounter [-] [92923] Writer thread running {{(pid=92923) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:52:05 devstack cinder-volume[92923]: INFO cinder.rpc [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 13:52:05 devstack cinder-volume[92923]: INFO cinder.rpc [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_db.sqlalchemy.engines [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92923) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:06 devstack cinder-volume[92923]: INFO cinder.volume.manager [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Determined volume DB was empty at startup. Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG cinder.volume.manager [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92923) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 13:52:06 devstack cinder-volume[92923]: INFO cinder.volume.manager [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 13:52:06 devstack cinder-volume[92923]: WARNING stevedore.named [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:52:06 devstack cinder-volume[92923]: WARNING castellan.key_manager [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:52:06 devstack cinder-volume[92923]: WARNING cinder.keymgr.conf_key_mgr [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:52:06 devstack cinder-volume[92923]: INFO cinder.volume.manager [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_db.sqlalchemy.engines [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92923) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:06 devstack cinder-volume[92923]: INFO oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Starting 1 workers Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Started child 93146 {{(pid=92923) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Full set of CONF: {{(pid=92923) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] ******************************************************************************** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Configuration options gathered from: {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] ================================================================================ {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 13:52:06 devstack cinder-volume[93146]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] allow_availability_zone_fallback = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] allow_compression_on_image_upload = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] allowed_direct_url_schemes = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] api_rate_limit = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] auth_strategy = keystone {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_availability_zone = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_host = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_stats_polling_interval = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backup_api_class = cinder.backup.api.API {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backup_name_template = backup-%s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backup_use_same_host = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backup_use_temp_snapshot = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] chap_password = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] chap_username = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_internal_tenant_project_id = 61e0210faaaf4182a8cf801c3abc2970 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_internal_tenant_user_id = 6a311fce0b3a462baa2a1653e16c89c8 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cluster = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] compression_format = gzip {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] compute_api_class = cinder.compute.nova.API {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] config_dir = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] config_source = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] control_exchange = openstack {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] debug = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] default_availability_zone = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] default_group_type = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] default_volume_type = QuobyteHD {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] disk_geometry = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] driver_client_cert = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] driver_client_cert_key = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] driver_data_namespace = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] driver_ssl_cert_path = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] driver_ssl_cert_verify = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] driver_use_ssl = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] enable_new_services = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] enable_unsupported_driver = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] enabled_backends = ['QuobyteHD'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] enforce_multipath_for_image_xfer = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] filter_function = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_api_insecure = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_api_ssl_compression = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_ca_certificates_file = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_catalog_info = image:glance:publicURL {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_num_retries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance_request_timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] goodness_function = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] graceful_shutdown_timeout = 5 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] group_api_class = cinder.group.api.API {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] host = devstack {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_compress_on_upload = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_conversion_address_space_limit = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_conversion_cpu_limit = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_conversion_disable = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_upload_use_cinder_backend = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_upload_use_internal_tenant = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_volume_cache_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_volume_cache_max_count = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] image_volume_cache_max_size_gb = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] init_host_max_objects_retrieval = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] instance_format = [instance: %(uuid)s] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] iscsi_target_flags = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] iscsi_write_cache = on {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] iser_helper = tgtadm {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] iser_ip_address = 192.168.122.163 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] iser_port = 3260 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_color = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_config_append = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_dir = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_file = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_options = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_rotate_interval = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_rotate_interval_type = days {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] log_rotation_type = none {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] max_age = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] max_logfile_count = 30 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] max_logfile_size_mb = 200 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] max_over_subscription_ratio = 20.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] message_reap_interval = 86400 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] message_ttl = 2592000 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] migration_create_volume_timeout_secs = 300 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93146]: INFO cinder.volume.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.remotefs [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93146) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] monkey_patch = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] monkey_patch_modules = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] my_ip = 192.168.122.163 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] no_snapshot_gb_quota = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] num_iser_scan_tries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] num_shell_tries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] num_volume_device_scan_tries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] nvmeof_conn_info_version = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] nvmet_ns_id = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] nvmet_port_id = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_max_limit = 1000 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_volume_ext_list = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_volume_listen = 0.0.0.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_volume_listen_port = 8776 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_volume_use_ssl = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] osapi_volume_workers = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] per_volume_size_limit = -1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] periodic_fuzzy_delay = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] periodic_interval = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] project_id_regex = [0-9a-f\-]+ {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] public_endpoint = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] publish_errors = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_backup_gigabytes = 1000 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_backups = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_gigabytes = 1000 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_groups = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_snapshots = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] quota_volumes = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] rate_limit_burst = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] rate_limit_except_level = CRITICAL {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] rate_limit_interval = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] reinit_driver_count = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] replication_device = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] report_discard_supported = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] report_interval = 120 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] reservation_clean_interval = 86400 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] reservation_expire = 86400 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] reserved_image_namespaces = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] reserved_percentage = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] rpc_response_timeout = 120 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] run_external_periodic_tasks = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] scst_target_driver = iscsi {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] scst_target_iqn_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_down_time = 720 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] shell_completion = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] snapshot_name_template = snapshot-%s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] split_loggers = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] state_path = /opt/stack/data/cinder {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] storage_availability_zone = nova {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] storage_protocol = iSCSI {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] syslog_log_facility = LOG_USER {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] target_helper = lioadm {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] target_ip_address = 192.168.122.163 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] target_port = 3260 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] target_protocol = iscsi {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] target_secondary_ip_addresses = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] trace_flags = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] transfer_api_class = cinder.transfer.api.API {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] transport_url = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] until_refresh = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_chap_auth = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_default_quota_class = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_journal = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_json = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_multipath_for_image_xfer = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_stderr = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] use_syslog = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] verify_glance_signatures = enabled {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_api_class = cinder.volume.api.API {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_backend_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_clear = zero {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_clear_ionice = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_clear_size = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_copy_bps_limit = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_dd_blocksize = 1M {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_name_template = volume-%s {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_service_inithost_offload = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volume_usage_audit_period = month {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] zoning_mode = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_concurrency.disable_process_locking = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.auth_section = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.auth_type = password {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.auth_version = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.cache = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.delay_auth_decision = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.http_connect_timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.include_service_catalog = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.insecure = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.interface = public {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_password = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcache_username = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.region_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.service_token_roles_required = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.service_type = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.token_cache_time = 300 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.backend = dogpile.cache.null {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.backend_argument = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.backend_expiration_time = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.config_prefix = cache.oslo {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.debug_cache_backend = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.enable_retry_client = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.enable_socket_keepalive = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.expiration_time = 600 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.hashclient_retry_attempts = 2 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_dead_retry = 300 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_pool_maxsize = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_sasl_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.password = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.proxies = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.redis_db = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.redis_sentinel_service_name = mymaster {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.redis_server = localhost:6379 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.retry_attempts = 2 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.retry_delay = 0.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.socket_keepalive_count = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.socket_keepalive_idle = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.socket_keepalive_interval = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.socket_timeout = 1.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.tls_allowed_ciphers = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.tls_cafile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.tls_certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.tls_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.tls_keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cache.username = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] coordination.backend_url = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.asyncio_connection = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.asyncio_slave_connection = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.backend = sqlalchemy {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.connection = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.connection_debug = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.connection_parameters = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.connection_recycle_time = 3600 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.connection_trace = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.db_inc_retry_interval = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.db_max_retries = 20 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.db_max_retry_interval = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.db_retry_interval = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.max_overflow = 50 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.max_pool_size = 5 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.max_retries = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93146) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 13:52:06 devstack cinder-volume[93146]: WARNING cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 13:52:06 devstack cinder-volume[93146]: WARNING cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.mysql_wsrep_sync_wait = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Running cmd (subprocess): mount.quobyte {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.pool_timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.retry_interval = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.slave_connection = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.sqlite_synchronous = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.synchronous_reader = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] database.use_db_reconnect = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.connection_string = messaging:// {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.es_doc_type = notification {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.es_scroll_size = 10000 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.es_scroll_time = 2m {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.filter_error_trace = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.hmac_keys = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.sentinel_service_name = mymaster {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.socket_timeout = 0.1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.trace_requests = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler.trace_sqlalchemy = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler_jaeger.process_tags = {} {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler_jaeger.service_name_prefix = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] profiler_otlp.service_name_prefix = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.enforce_new_defaults = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: WARNING oslo_config.cfg [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.enforce_scope = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.policy_default_rule = default {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.policy_file = policy.yaml {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_policy.remote_timeout = 60.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.group = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.helper_command = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] privsep_osbrick.user = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.group = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.helper_command = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] cinder_sys_admin.user = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.auth_section = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.auth_type = password {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.cafile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.collect_timing = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.insecure = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.send_service_user_token = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.split_loggers = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] service_user.timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.auth_section = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.auth_type = password {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.collect_timing = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.insecure = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.region_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.split_loggers = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] glance.timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.backend_availability_zone = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.chap_password = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.chap_username = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.disk_geometry = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.driver_client_cert = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.driver_client_cert_key = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.driver_data_namespace = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.driver_use_ssl = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.enable_unsupported_driver = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.extra_capabilities = {} {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.filter_function = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.goodness_function = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.iscsi_target_flags = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.iscsi_write_cache = on {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.iser_helper = tgtadm {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.iser_port = 3260 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_host = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_login = admin {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_mount_options = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_password = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_private_key = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_share_path = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_ssh_port = 22 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack quobyte-client[93151]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 13:52:06 devstack quobyte-client[93151]: Invalid parameters found, error: missing mount point. Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.num_shell_tries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack quobyte-client[93151]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.nvmet_port_id = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_client_cfg = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack quobyte-client[93151]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93146]: INFO cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e ... Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c -c /etc/quobyte/client-cinder.cfg {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.quobyte_volume_url = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.replication_device = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.report_discard_supported = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.reserved_percentage = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.scst_target_driver = iscsi {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.scst_target_iqn_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.storage_protocol = iSCSI {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.target_helper = tgtadm {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.target_port = 3260 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.target_protocol = iscsi {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.trace_flags = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.unique_fqdn_network = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.use_chap_auth = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_backend_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_clear = zero {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_clear_ionice = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_clear_size = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_reports.file_event_handler = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_reports.log_dir = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.backend_availability_zone = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.backend_host = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.chap_password = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.chap_username = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c -c /etc/quobyte/client-cinder.cfg Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.chiscsi_conf = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.disk_geometry = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.driver_client_cert = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.driver_client_cert_key = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.driver_data_namespace = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.driver_use_ssl = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.extra_capabilities = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.filter_function = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.goodness_function = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.iscsi_target_flags = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.iscsi_write_cache = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.iser_helper = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.iser_ip_address = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.iser_port = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.iser_target_prefix = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_host = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_login = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_mount_options = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_password = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_private_key = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_share_path = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_ssh_port = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.num_shell_tries = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nvmet_ns_id = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.nvmet_port_id = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.replication_device = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.report_discard_supported = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.reserved_percentage = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.scst_target_driver = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.storage_protocol = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.target_helper = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.target_ip_address = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.target_port = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.target_prefix = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.target_protocol = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.trace_flags = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.unique_fqdn_network = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.use_chap_auth = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_clear = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_clear_ionice = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_clear_size = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] QuobyteHD.volumes_dir = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.ssl_version = {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_notifications.driver = [] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_notifications.retry = -1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] oslo_messaging_notifications.transport_url = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] key_manager.fixed_key = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.barbican_api_version = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.barbican_endpoint = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.barbican_endpoint_type = public {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.barbican_region_name = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.cafile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.collect_timing = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.insecure = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.number_of_retries = 60 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.retry_delay = 1 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.send_service_user_token = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.split_loggers = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.verify_ssl = True {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican.verify_ssl_path = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.auth_section = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.auth_type = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.cafile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.certfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.collect_timing = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.insecure = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.keyfile = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.split_loggers = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] barbican_service_user.timeout = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.approle_role_id = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.approle_secret_id = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.kv_mountpoint = secret {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.kv_path = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.kv_version = 2 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.namespace = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.root_token_id = **** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.ssl_ca_crt_file = None {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.timeout = 60.0 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.use_ssl = False {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] ******************************************************************************** {{(pid=92923) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 13:52:07 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:07 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.798s {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:07 devstack cinder-volume[93146]: INFO cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e succeeded Jun 23 13:52:07 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:07 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.814s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:07 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:07 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:07 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:08 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.615s {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:08 devstack cinder-volume[93146]: INFO cinder.volume.driver [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.volume.driver [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93146) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_db.sqlalchemy.engines [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG dbcounter [-] [93146] Writer thread running {{(pid=93146) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.db.api [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Building query based on filter {{(pid=93146) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.image.image_utils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93146) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 13:52:08 devstack cinder-volume[93146]: INFO cinder.keymgr.migration [None req-067eb0e2-f6fd-401b-8904-eeb2915843e1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:08 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:08 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:08 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.617s {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Notifying Schedulers of capabilities ... {{(pid=93146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:52:08 devstack cinder-volume[93146]: INFO cinder.volume.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Driver initialization completed successfully. Jun 23 13:52:08 devstack cinder-volume[93146]: INFO cinder.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Initiating service 3 cleanup Jun 23 13:52:08 devstack cinder-volume[93146]: INFO cinder.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Service 3 cleanup completed. Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.service [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Creating RPC server for service cinder-volume {{(pid=93146) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.service [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93146) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 13:52:08 devstack cinder-volume[93146]: INFO cinder.volume.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:08 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:08 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:08 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:09 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:09 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.852s {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:09 devstack cinder-volume[93146]: INFO cinder.volume.manager [None req-d011e32d-907f-4e58-a565-232f05514c51 None None] Driver post RPC initialization completed successfully. Jun 23 13:52:13 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:13 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:13 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:13 devstack cinder-volume[93146]: DEBUG cinder.volume.drivers.quobyte [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:13 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93146) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:13 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:13 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:13 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:14 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:14 devstack cinder-volume[93146]: DEBUG oslo_concurrency.processutils [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.601s {{(pid=93146) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:14 devstack cinder-volume[93146]: DEBUG cinder.manager [None req-55c4154e-32bb-4b61-87bd-920ffaf38851 None None] Notifying Schedulers of capabilities ... {{(pid=93146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:52:15 devstack cinder-volume[92923]: INFO oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Caught SIGTERM, stopping children Jun 23 13:52:15 devstack cinder-volume[92923]: DEBUG oslo_concurrency.lockutils [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Acquiring lock "singleton_lock" {{(pid=92923) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:15 devstack cinder-volume[92923]: DEBUG oslo_concurrency.lockutils [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Acquired lock "singleton_lock" {{(pid=92923) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:15 devstack cinder-volume[92923]: DEBUG oslo_concurrency.lockutils [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Releasing lock "singleton_lock" {{(pid=92923) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:15 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Stop services. {{(pid=92923) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 13:52:15 devstack cinder-volume[92923]: DEBUG oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Killing children. {{(pid=92923) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 13:52:15 devstack cinder-volume[92923]: INFO oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Waiting on 1 children to exit Jun 23 13:52:17 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Acquiring lock "singleton_lock" {{(pid=93146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:17 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Acquired lock "singleton_lock" {{(pid=93146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:17 devstack cinder-volume[93146]: DEBUG oslo_concurrency.lockutils [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Releasing lock "singleton_lock" {{(pid=93146) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:17 devstack cinder-volume[93146]: WARNING amqp [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:52:17 devstack cinder-volume[93146]: WARNING amqp [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:52:17 devstack cinder-volume[92923]: INFO oslo_service.backend._eventlet.service [None req-83c9b2cb-9c5e-4bbe-a099-3cf6bb68dc0d None None] Child 93146 exited with status 0 Jun 23 13:52:17 devstack cinder-volume[93424]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 13:52:17 devstack cinder-volume[93424]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:52:17 devstack cinder-volume[93424]: we strongly recommend against using it for new projects. Jun 23 13:52:17 devstack cinder-volume[93424]: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:52:17 devstack cinder-volume[93424]: framework. For more detail see Jun 23 13:52:17 devstack cinder-volume[93424]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:52:17 devstack cinder-volume[93424]: import eventlet # noqa Jun 23 13:52:20 devstack cinder-volume[93424]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93424) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:20 devstack cinder-volume[93424]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93424) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:20 devstack cinder-volume[93424]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93424) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:21 devstack cinder-volume[93424]: INFO dbcounter [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Registered counter for database cinder Jun 23 13:52:21 devstack cinder-volume[93424]: DEBUG oslo_db.sqlalchemy.engines [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG dbcounter [-] [93424] Writer thread running {{(pid=93424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:52:22 devstack cinder-volume[93424]: INFO cinder.rpc [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 13:52:22 devstack cinder-volume[93424]: INFO cinder.rpc [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_db.sqlalchemy.engines [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:22 devstack cinder-volume[93424]: INFO cinder.volume.manager [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Determined volume DB was empty at startup. Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG cinder.volume.manager [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93424) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 13:52:22 devstack cinder-volume[93424]: WARNING stevedore.named [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:52:22 devstack cinder-volume[93424]: WARNING castellan.key_manager [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:52:22 devstack cinder-volume[93424]: WARNING cinder.keymgr.conf_key_mgr [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:52:22 devstack cinder-volume[93424]: INFO cinder.volume.manager [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_db.sqlalchemy.engines [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:22 devstack cinder-volume[93424]: INFO oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Starting 1 workers Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Started child 93689 {{(pid=93424) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Full set of CONF: {{(pid=93424) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] ******************************************************************************** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Configuration options gathered from: {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 13:52:22 devstack cinder-volume[93689]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] ================================================================================ {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] allow_availability_zone_fallback = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] allow_compression_on_image_upload = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] allowed_direct_url_schemes = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] api_rate_limit = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] auth_strategy = keystone {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_availability_zone = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_host = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_stats_polling_interval = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backup_api_class = cinder.backup.api.API {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backup_name_template = backup-%s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backup_use_same_host = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backup_use_temp_snapshot = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] chap_password = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] chap_username = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_internal_tenant_project_id = 61e0210faaaf4182a8cf801c3abc2970 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_internal_tenant_user_id = 6a311fce0b3a462baa2a1653e16c89c8 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cluster = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] compression_format = gzip {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] compute_api_class = cinder.compute.nova.API {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] config_dir = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] config_source = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] control_exchange = openstack {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] debug = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] default_availability_zone = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] default_group_type = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] default_volume_type = QuobyteHD {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] disk_geometry = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] driver_client_cert = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] driver_client_cert_key = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] driver_data_namespace = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] driver_ssl_cert_path = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] driver_ssl_cert_verify = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] driver_use_ssl = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] enable_new_services = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] enable_unsupported_driver = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] enabled_backends = ['QuobyteHD'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] enforce_multipath_for_image_xfer = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] filter_function = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_api_insecure = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_api_servers = ['http://192.168.122.163/image'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_api_ssl_compression = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_ca_certificates_file = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_catalog_info = image:glance:publicURL {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_num_retries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance_request_timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] goodness_function = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] graceful_shutdown_timeout = 5 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] group_api_class = cinder.group.api.API {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] host = devstack {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_compress_on_upload = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_conversion_address_space_limit = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_conversion_cpu_limit = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_conversion_disable = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_upload_use_cinder_backend = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_upload_use_internal_tenant = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_volume_cache_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_volume_cache_max_count = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] image_volume_cache_max_size_gb = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] init_host_max_objects_retrieval = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] instance_format = [instance: %(uuid)s] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] iscsi_target_flags = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] iscsi_write_cache = on {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] iser_helper = tgtadm {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] iser_ip_address = 192.168.122.163 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] iser_port = 3260 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_color = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_config_append = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_dir = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_file = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_options = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_rotate_interval = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_rotate_interval_type = days {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] log_rotation_type = none {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] max_age = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93689) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] max_logfile_count = 30 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] max_logfile_size_mb = 200 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] max_over_subscription_ratio = 20.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] message_reap_interval = 86400 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] message_ttl = 2592000 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] migration_create_volume_timeout_secs = 300 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] monkey_patch = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] monkey_patch_modules = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] my_ip = 192.168.122.163 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] no_snapshot_gb_quota = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] num_iser_scan_tries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] num_shell_tries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] num_volume_device_scan_tries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] nvmeof_conn_info_version = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] nvmet_ns_id = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] nvmet_port_id = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_max_limit = 1000 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_volume_ext_list = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_volume_listen_port = 8776 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_volume_use_ssl = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] osapi_volume_workers = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] per_volume_size_limit = -1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] periodic_fuzzy_delay = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] periodic_interval = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] public_endpoint = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] publish_errors = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_backup_gigabytes = 1000 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_backups = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_gigabytes = 1000 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_groups = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_snapshots = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] quota_volumes = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] rate_limit_burst = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] rate_limit_except_level = CRITICAL {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] rate_limit_interval = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] reinit_driver_count = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] replication_device = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] report_discard_supported = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] report_interval = 120 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] reservation_clean_interval = 86400 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] reservation_expire = 86400 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] reserved_image_namespaces = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] reserved_percentage = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] rpc_response_timeout = 120 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] run_external_periodic_tasks = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] scst_target_driver = iscsi {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] scst_target_iqn_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_down_time = 720 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] shell_completion = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] snapshot_name_template = snapshot-%s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] split_loggers = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] state_path = /opt/stack/data/cinder {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] storage_availability_zone = nova {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] storage_protocol = iSCSI {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] syslog_log_facility = LOG_USER {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] target_helper = lioadm {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] target_ip_address = 192.168.122.163 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] target_port = 3260 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] target_protocol = iscsi {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] target_secondary_ip_addresses = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] trace_flags = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] transport_url = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] until_refresh = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_chap_auth = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_default_quota_class = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_journal = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_json = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_multipath_for_image_xfer = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_stderr = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] use_syslog = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] verify_glance_signatures = enabled {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_api_class = cinder.volume.api.API {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_backend_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_clear = zero {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_clear_ionice = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_clear_size = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_copy_bps_limit = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_dd_blocksize = 1M {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_name_template = volume-%s {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_service_inithost_offload = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volume_usage_audit_period = month {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] zoning_mode = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_concurrency.disable_process_locking = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.auth_section = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.auth_type = password {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.auth_version = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.cache = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.include_service_catalog = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.insecure = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.interface = public {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_password = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcache_username = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.region_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.service_type = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.163/identity {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.backend = dogpile.cache.null {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.backend_argument = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.backend_expiration_time = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.config_prefix = cache.oslo {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.debug_cache_backend = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.enable_retry_client = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.enable_socket_keepalive = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.expiration_time = 600 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.hashclient_retry_attempts = 2 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_dead_retry = 300 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_pool_maxsize = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_sasl_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.password = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.proxies = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.redis_db = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.redis_server = localhost:6379 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.retry_attempts = 2 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.retry_delay = 0.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.socket_keepalive_count = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.socket_keepalive_idle = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.socket_keepalive_interval = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.socket_timeout = 1.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.tls_allowed_ciphers = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.tls_cafile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.tls_certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.tls_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.tls_keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cache.username = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] coordination.backend_url = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.asyncio_connection = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.asyncio_slave_connection = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.backend = sqlalchemy {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.connection = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.connection_debug = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.connection_parameters = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.connection_recycle_time = 3600 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.connection_trace = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.db_inc_retry_interval = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.db_max_retries = 20 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.db_max_retry_interval = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.db_retry_interval = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.max_overflow = 50 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.max_pool_size = 5 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.max_retries = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.mysql_wsrep_sync_wait = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.pool_timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.retry_interval = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.slave_connection = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.sqlite_synchronous = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.synchronous_reader = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] database.use_db_reconnect = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.connection_string = messaging:// {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.es_doc_type = notification {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.es_scroll_size = 10000 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.es_scroll_time = 2m {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.filter_error_trace = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.hmac_keys = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.sentinel_service_name = mymaster {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.socket_timeout = 0.1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.trace_requests = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler.trace_sqlalchemy = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler_jaeger.process_tags = {} {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler_jaeger.service_name_prefix = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] profiler_otlp.service_name_prefix = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.enforce_new_defaults = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: WARNING oslo_config.cfg [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.enforce_scope = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.policy_default_rule = default {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.policy_file = policy.yaml {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.group = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.helper_command = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] privsep_osbrick.user = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.group = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.helper_command = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] cinder_sys_admin.user = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.auth_section = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.auth_type = password {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.cafile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.collect_timing = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.insecure = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.send_service_user_token = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.split_loggers = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] service_user.timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.auth_section = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.auth_type = password {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.collect_timing = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.insecure = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.region_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.split_loggers = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] glance.timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.backend_availability_zone = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.chap_password = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.chap_username = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.disk_geometry = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.driver_client_cert = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.driver_client_cert_key = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.driver_data_namespace = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.driver_use_ssl = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.extra_capabilities = {} {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.filter_function = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.goodness_function = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.iscsi_target_flags = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.iscsi_write_cache = on {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.iser_helper = tgtadm {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.iser_ip_address = 192.168.122.163 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.iser_port = 3260 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_host = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_login = admin {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_mount_options = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_password = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_private_key = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_share_path = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.num_shell_tries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.quobyte_volume_url = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.replication_device = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.report_discard_supported = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.reserved_percentage = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.target_helper = tgtadm {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.target_ip_address = 192.168.122.163 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.target_port = 3260 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.target_protocol = iscsi {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.trace_flags = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.unique_fqdn_network = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.use_chap_auth = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_backend_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_clear = zero {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_clear_ionice = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_clear_size = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_reports.file_event_handler = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_reports.log_dir = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.backend_availability_zone = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.backend_host = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.chap_password = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.chap_username = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.chiscsi_conf = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.disk_geometry = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.driver_client_cert = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.driver_data_namespace = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.driver_use_ssl = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93689) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 13:52:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.extra_capabilities = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.filter_function = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.goodness_function = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.iser_helper = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.iser_ip_address = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.iser_port = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.iser_target_prefix = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_host = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_login = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_mount_options = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Running cmd (subprocess): mount.quobyte {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_password = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_private_key = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_share_path = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_ssh_port = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.num_shell_tries = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.nvmet_port_id = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.replication_device = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.report_discard_supported = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.reserved_percentage = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.scst_target_driver = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.storage_protocol = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.target_helper = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.target_ip_address = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.target_port = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.target_prefix = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.target_protocol = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.trace_flags = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.use_chap_auth = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_clear = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_clear_size = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] QuobyteHD.volumes_dir = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_notifications.driver = [] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_notifications.retry = -1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] key_manager.fixed_key = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.barbican_api_version = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.barbican_endpoint = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.barbican_endpoint_type = public {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.barbican_region_name = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.cafile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.collect_timing = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.insecure = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.number_of_retries = 60 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.retry_delay = 1 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.send_service_user_token = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.split_loggers = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.verify_ssl = True {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican.verify_ssl_path = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.auth_section = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.auth_type = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.cafile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.certfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.collect_timing = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.insecure = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.keyfile = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.split_loggers = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] barbican_service_user.timeout = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.approle_role_id = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.approle_secret_id = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.kv_mountpoint = secret {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.kv_path = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.kv_version = 2 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.namespace = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.root_token_id = **** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.ssl_ca_crt_file = None {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.timeout = 60.0 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.use_ssl = False {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:22 devstack cinder-volume[93424]: DEBUG oslo_service.backend._eventlet.service [None req-25e77670-e77d-4aa7-b11b-32af4c346019 None None] ******************************************************************************** {{(pid=93424) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 13:52:22 devstack quobyte-client[93704]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 13:52:22 devstack quobyte-client[93704]: Invalid parameters found, error: missing mount point. Jun 23 13:52:22 devstack quobyte-client[93704]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 13:52:22 devstack quobyte-client[93704]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] CMD "mount.quobyte" returned: 1 in 0.169s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:22 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:22 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:23 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.838s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:23 devstack cinder-volume[93689]: INFO cinder.volume.driver [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Driver hasn't implemented _init_vendor_properties() Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG cinder.volume.driver [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93689) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG oslo_db.sqlalchemy.engines [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writer thread running {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG cinder.db.api [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Building query based on filter {{(pid=93689) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93689) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:23 devstack cinder-volume[93689]: INFO cinder.keymgr.migration [None req-cd19faf1-8b70-46ea-b624-d476e2832412 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 13:52:23 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:23 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:24 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.622s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:52:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Driver initialization completed successfully. Jun 23 13:52:24 devstack cinder-volume[93689]: INFO cinder.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Initiating service 3 cleanup Jun 23 13:52:24 devstack cinder-volume[93689]: INFO cinder.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Service 3 cleanup completed. Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG cinder.service [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Creating RPC server for service cinder-volume {{(pid=93689) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG cinder.service [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93689) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 13:52:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:24 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:52:24 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:25 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.624s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:25 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b489422e-e8e0-4aeb-bc0b-8aa9b859d2cb None None] Driver post RPC initialization completed successfully. Jun 23 13:52:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:52:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 6 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:52:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:52:32 devstack cinder-volume[93424]: DEBUG dbcounter [-] [93424] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:52:34 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:52:35 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:32 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:53:32 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:34 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.783s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:34 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:53:34 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:53:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 6 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:53:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Flow 'volume_create_manager' (13f719c6-ed41-46f7-bad8-86a211723d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6bc8e3-7752-4bfc-a73e-052990c6df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6bc8e3-7752-4bfc-a73e-052990c6df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1157737149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165939ad-c567-47fd-afd8-516acc96e7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ac1d6f33f24ec4925ac4e64f6ad63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:53:50Z,use_quota=True,user_id='ab4de5ddebeb48a79b36acd2b2841d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06d35ff-2671-4805-903c-3d78bdbff6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06d35ff-2671-4805-903c-3d78bdbff6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d071ac7-1473-47c5-a087-a17e6cf6c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d071ac7-1473-47c5-a087-a17e6cf6c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165939ad-c567-47fd-afd8-516acc96e7b0', 'volume_name': 'volume-165939ad-c567-47fd-afd8-516acc96e7b0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66114e5-cdd6-4954-8c93-b0ac0311e311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66114e5-cdd6-4954-8c93-b0ac0311e311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f157c0de-f44e-4fb0-a316-41c381fa9dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:50 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Volume 165939ad-c567-47fd-afd8-516acc96e7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165939ad-c567-47fd-afd8-516acc96e7b0', 'volume_size': 1} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1157737149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165939ad-c567-47fd-afd8-516acc96e7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ac1d6f33f24ec4925ac4e64f6ad63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:53:50Z,use_quota=True,user_id='ab4de5ddebeb48a79b36acd2b2841d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Creating volume 165939ad-c567-47fd-afd8-516acc96e7b0 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:53:50 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:53:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:50 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 1073741824 Jun 23 13:53:50 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:53 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 1073741824" returned: 0 in 2.259s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:53 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 Jun 23 13:53:53 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:54 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0" returned: 0 in 1.206s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] <== create_volume: return (3610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.612s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f157c0de-f44e-4fb0-a316-41c381fa9dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165939ad-c567-47fd-afd8-516acc96e7b0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16335a9-675d-43a1-9472-097ab6232963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:54 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Volume volume-165939ad-c567-47fd-afd8-516acc96e7b0 (165939ad-c567-47fd-afd8-516acc96e7b0): created successfully Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16335a9-675d-43a1-9472-097ab6232963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Flow 'volume_create_manager' (13f719c6-ed41-46f7-bad8-86a211723d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:53:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ee8b2af0-92ed-47fc-b1c7-844821730981 tempest-DeleteServersTestJSON-116536230 None] Created volume successfully. Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Flow 'volume_create_manager' (2deba8e7-7629-4fcc-a256-eb99f78daddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d623c672-fad8-4c86-a0e3-a7769800c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d623c672-fad8-4c86-a0e3-a7769800c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1725040170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edec1dac-f9b0-44bd-be23-c260f06cd937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e87befe6c7d46bb8b14459f5c01bf27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:01Z,use_quota=True,user_id='48107daefa0e4a918f070ad63e167bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957bc44-fa84-4cde-a8a0-6c086d568da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957bc44-fa84-4cde-a8a0-6c086d568da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f2f444-48d9-4b19-94c8-737afb96ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f2f444-48d9-4b19-94c8-737afb96ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edec1dac-f9b0-44bd-be23-c260f06cd937', 'volume_name': 'volume-edec1dac-f9b0-44bd-be23-c260f06cd937', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b840c0d-beeb-480e-b589-1cd7e447095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b840c0d-beeb-480e-b589-1cd7e447095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fe4551-5ef7-41f1-98ae-abcfebf2c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:00 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Volume edec1dac-f9b0-44bd-be23-c260f06cd937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edec1dac-f9b0-44bd-be23-c260f06cd937', 'volume_size': 1} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1725040170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edec1dac-f9b0-44bd-be23-c260f06cd937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e87befe6c7d46bb8b14459f5c01bf27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:01Z,use_quota=True,user_id='48107daefa0e4a918f070ad63e167bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Creating volume edec1dac-f9b0-44bd-be23-c260f06cd937 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:54:00 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:54:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:00 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 1073741824 Jun 23 13:54:00 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:02 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 1073741824" returned: 0 in 1.891s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:02 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 Jun 23 13:54:02 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:04 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937" returned: 0 in 1.370s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] <== create_volume: return (3416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.423s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fe4551-5ef7-41f1-98ae-abcfebf2c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edec1dac-f9b0-44bd-be23-c260f06cd937', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6d2783-672c-4d2c-bd5d-c58ae5e8daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Volume volume-edec1dac-f9b0-44bd-be23-c260f06cd937 (edec1dac-f9b0-44bd-be23-c260f06cd937): created successfully Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6d2783-672c-4d2c-bd5d-c58ae5e8daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Flow 'volume_create_manager' (2deba8e7-7629-4fcc-a256-eb99f78daddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a493b4be-8979-424f-bdbe-4215fa291e10 tempest-ServerRescueNegativeTestJSON-1257671912 None] Created volume successfully. Jun 23 13:54:05 devstack cinder-volume[93689]: WARNING py.warnings [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 23 13:54:05 devstack cinder-volume[93689]: .first() Jun 23 13:54:05 devstack cinder-volume[93689]: Jun 23 13:54:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:05 devstack cinder-volume[93689]: INFO oslo.privsep.daemon [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxf1v4g1w/privsep.sock'] Jun 23 13:54:05 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxf1v4g1w/privsep.sock Jun 23 13:54:05 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:06 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:07 devstack cinder-volume[93689]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 13:54:08 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:08 devstack cinder-volume[93689]: INFO oslo.privsep.daemon [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Spawned new privsep daemon via rootwrap Jun 23 13:54:08 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Accepted privsep connection to /tmp/tmpxf1v4g1w/privsep.sock {{(pid=93689) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 13:54:08 devstack cinder-volume[93689]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 13:54:08 devstack cinder-volume[93689]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 13:54:08 devstack cinder-volume[93689]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 13:54:08 devstack cinder-volume[93689]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95307 Jun 23 13:54:08 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7994b2c3-fa44-4781-837e-f5399cf39cd7]: (2,) {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:08 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f5c411-8629-453e-a38f-4600db4cd653]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:08 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 Jun 23 13:54:08 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:09 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0" returned: 0 in 1.022s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.995s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-165939ad-c567-47fd-afd8-516acc96e7b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5133771b-b3b8-4bf8-bf3a-e3ebe3dc4f50', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:54:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d4dc6189-7dd1-4041-9835-1a0dba1d5aad req-0153bda4-537c-4608-9c35-8e15c9a724a7 tempest-DeleteServersTestJSON-116536230 None] attachment_update completed successfully. Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Flow 'volume_create_manager' (9f5367e8-45de-4480-b2c2-1533d98439a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99017bf7-945e-4882-9a01-90c879684000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99017bf7-945e-4882-9a01-90c879684000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-921376771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b9756c-3c61-4d70-b210-4a3c7d105a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adbaf4009d742e7ab767de3bc59bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:19Z,use_quota=True,user_id='9049bb1c591846fa87572cd9c100e479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b324867-0392-4c7d-82c5-b6ebed70de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b324867-0392-4c7d-82c5-b6ebed70de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9b8df8-094f-42f7-857a-697c2c2df6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9b8df8-094f-42f7-857a-697c2c2df6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b9756c-3c61-4d70-b210-4a3c7d105a04', 'volume_name': 'volume-43b9756c-3c61-4d70-b210-4a3c7d105a04', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75083cd5-460a-4f21-85c7-093b35c6596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75083cd5-460a-4f21-85c7-093b35c6596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc629839-e872-489d-9e4c-647eb7afddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Volume 43b9756c-3c61-4d70-b210-4a3c7d105a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b9756c-3c61-4d70-b210-4a3c7d105a04', 'volume_size': 1} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-921376771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b9756c-3c61-4d70-b210-4a3c7d105a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adbaf4009d742e7ab767de3bc59bb34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:19Z,use_quota=True,user_id='9049bb1c591846fa87572cd9c100e479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Creating volume 43b9756c-3c61-4d70-b210-4a3c7d105a04 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:54:19 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:54:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:19 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 1073741824 Jun 23 13:54:19 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:21 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 1073741824" returned: 0 in 1.718s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:21 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 Jun 23 13:54:21 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:22 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04" returned: 0 in 1.074s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] <== create_volume: return (2881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.884s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc629839-e872-489d-9e4c-647eb7afddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b9756c-3c61-4d70-b210-4a3c7d105a04', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddbfe70-6b8c-434e-979d-c7d80c92d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:22 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Volume volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 (43b9756c-3c61-4d70-b210-4a3c7d105a04): created successfully Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddbfe70-6b8c-434e-979d-c7d80c92d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Flow 'volume_create_manager' (9f5367e8-45de-4480-b2c2-1533d98439a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-221f098e-8a8a-49f5-9824-e75d5ad4291d tempest-ServerActionsTestOtherA-1739418772 None] Created volume successfully. Jun 23 13:54:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-88846fed-bcd7-498b-8fcb-28d648643d61 req-6fb8ff4a-1d8d-481d-a9e4-36fc3edcc719 tempest-DeleteServersTestJSON-116536230 None] Terminate volume connection completed successfully. Jun 23 13:54:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-88846fed-bcd7-498b-8fcb-28d648643d61 req-6fb8ff4a-1d8d-481d-a9e4-36fc3edcc719 tempest-DeleteServersTestJSON-116536230 None] Deleting attachment 5133771b-b3b8-4bf8-bf3a-e3ebe3dc4f50. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:54:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Acquiring lock "cinder-165939ad-c567-47fd-afd8-516acc96e7b0-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Lock "cinder-165939ad-c567-47fd-afd8-516acc96e7b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Acquiring lock "cinder-quobyte-165939ad-c567-47fd-afd8-516acc96e7b0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Lock "cinder-quobyte-165939ad-c567-47fd-afd8-516acc96e7b0" acquired by "delete_volume" :: waited 0.094s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:29 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a0614-9005-4805-a242-50f60d45c2d1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:29 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 Jun 23 13:54:29 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:30 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0" returned: 0 in 1.237s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:30 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0 Jun 23 13:54:30 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:31 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-165939ad-c567-47fd-afd8-516acc96e7b0" returned: 0 in 0.985s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Lock "cinder-quobyte-165939ad-c567-47fd-afd8-516acc96e7b0" released by "delete_volume" :: held 2.340s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:31 devstack cinder-volume[93689]: WARNING cinder.quota [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:54:31 devstack cinder-volume[93689]: WARNING cinder.quota [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Created reservations ['205aff0e-fcd2-41e0-964c-0f3c6fd6a358', 'dfba273a-dd3d-4ecd-9757-ca42ca577899', 'a5eaf92c-20f0-4ccf-b910-9b75fb002e57', 'dcd82868-eb69-4dc7-88d5-f6a9ce4c0abb'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:31 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:54:31 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:32 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:54:32 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:33 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.181s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:54:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Deleted volume successfully. Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a7de33e-1c5e-45f4-a2bc-099ea90302ec tempest-DeleteServersTestJSON-116536230 None] Lock "cinder-165939ad-c567-47fd-afd8-516acc96e7b0-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Acquiring lock "cinder-edec1dac-f9b0-44bd-be23-c260f06cd937-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "cinder-edec1dac-f9b0-44bd-be23-c260f06cd937-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:33 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.454s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Acquiring lock "cinder-quobyte-edec1dac-f9b0-44bd-be23-c260f06cd937" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "cinder-quobyte-edec1dac-f9b0-44bd-be23-c260f06cd937" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770bad2-43a5-481a-9ba0-7548ff380812]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:34 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 Jun 23 13:54:34 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:35 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937" returned: 0 in 1.304s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:35 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937 Jun 23 13:54:35 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:36 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edec1dac-f9b0-44bd-be23-c260f06cd937" returned: 0 in 1.080s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "cinder-quobyte-edec1dac-f9b0-44bd-be23-c260f06cd937" released by "delete_volume" :: held 2.463s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Created reservations ['a857cd1d-0ba3-4760-b77a-e7c2cbb80c37', 'e813993d-df7b-40ae-a448-5beb96d99332', '6ffdb08f-cc59-45e3-9910-c1e177202359', '1ae6b264-1f76-4cfd-9cc7-9075b7b69a1a'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:36 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:54:36 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:37 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.910s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:37 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:54:37 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Deleted volume successfully. Jun 23 13:54:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10e1794a-6b72-4032-aff1-39200ed51311 tempest-ServerRescueNegativeTestJSON-1257671912 None] Lock "cinder-edec1dac-f9b0-44bd-be23-c260f06cd937-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:46 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=6 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:54:47 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=4 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:55:23 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Flow 'volume_create_manager' (9721eeb8-3baf-4a99-955d-fbec79fc0b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8bc667-ca7b-41f7-bed3-5aa3098d6115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8bc667-ca7b-41f7-bed3-5aa3098d6115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-106730140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b884a6-30ca-4cee-845a-5829f12bb770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae47c65e737424dbc8fb4e95099fb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:24Z,use_quota=True,user_id='3d2fcb4884924e6cad0f8ef3a0f08cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1607b0f7-9441-49e9-956c-db37ff29a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1607b0f7-9441-49e9-956c-db37ff29a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f0b943-389a-4c56-b0e2-32d68dcc8615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f0b943-389a-4c56-b0e2-32d68dcc8615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b884a6-30ca-4cee-845a-5829f12bb770', 'volume_name': 'volume-26b884a6-30ca-4cee-845a-5829f12bb770', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ece1e-b2a0-4e75-9174-7a8f61c0de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ece1e-b2a0-4e75-9174-7a8f61c0de93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa4bdfa-9b5d-4874-b74c-8198307f4db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:24 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Volume 26b884a6-30ca-4cee-845a-5829f12bb770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b884a6-30ca-4cee-845a-5829f12bb770', 'volume_size': 1} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-106730140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b884a6-30ca-4cee-845a-5829f12bb770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae47c65e737424dbc8fb4e95099fb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:24Z,use_quota=True,user_id='3d2fcb4884924e6cad0f8ef3a0f08cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Creating volume 26b884a6-30ca-4cee-845a-5829f12bb770 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:55:24 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:55:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:24 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 1073741824 Jun 23 13:55:24 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:25 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 1073741824" returned: 0 in 0.967s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:25 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 Jun 23 13:55:25 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:26 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770" returned: 0 in 1.547s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] <== create_volume: return (2555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa4bdfa-9b5d-4874-b74c-8198307f4db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b884a6-30ca-4cee-845a-5829f12bb770', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c036b750-0a78-44ae-9b70-b6a43e53cac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:26 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Volume volume-26b884a6-30ca-4cee-845a-5829f12bb770 (26b884a6-30ca-4cee-845a-5829f12bb770): created successfully Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c036b750-0a78-44ae-9b70-b6a43e53cac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Flow 'volume_create_manager' (9721eeb8-3baf-4a99-955d-fbec79fc0b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-edb9e307-fa24-4d05-99ab-c46c27b8d2e3 tempest-TaggedAttachmentsTest-711185332 None] Created volume successfully. Jun 23 13:55:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:28 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[190af10a-1d53-44a2-b294-9cd64828147e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:55:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:28 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 Jun 23 13:55:28 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:29 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04" returned: 0 in 1.471s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.518s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-43b9756c-3c61-4d70-b210-4a3c7d105a04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e625ab15-1794-4945-bb3f-e305d4294ea5', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:55:29 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-4c1bd3c3-7160-4fc4-8174-d6e917a207dd req-a15b6207-e6ef-45f6-ac81-e6621082ed66 tempest-ServerActionsTestOtherA-1739418772 None] attachment_update completed successfully. Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Flow 'volume_create_manager' (06fc240f-436d-422f-abc3-afae952df207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a779ba63-315d-4893-951e-fdc9055d272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a779ba63-315d-4893-951e-fdc9055d272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-440010233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72dca016-d05e-474f-ac11-7c23314eb747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab476d15205461e81d50afc773c8dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:31Z,use_quota=True,user_id='2bca53ed137b479fab00571c4a4754be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9914c6a4-d323-4ec1-9071-12904aea179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9914c6a4-d323-4ec1-9071-12904aea179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c53cfd-61bc-4ee5-946a-40b1968e3830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c53cfd-61bc-4ee5-946a-40b1968e3830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72dca016-d05e-474f-ac11-7c23314eb747', 'volume_name': 'volume-72dca016-d05e-474f-ac11-7c23314eb747', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3ba180-7a9b-454a-b460-3928bbebbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3ba180-7a9b-454a-b460-3928bbebbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573c0742-8105-4f2a-afc0-25c90fb80b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Volume 72dca016-d05e-474f-ac11-7c23314eb747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72dca016-d05e-474f-ac11-7c23314eb747', 'volume_size': 1} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-440010233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72dca016-d05e-474f-ac11-7c23314eb747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab476d15205461e81d50afc773c8dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:31Z,use_quota=True,user_id='2bca53ed137b479fab00571c4a4754be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Creating volume 72dca016-d05e-474f-ac11-7c23314eb747 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:55:31 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:55:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:31 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 1073741824 Jun 23 13:55:31 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:32 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:55:32 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:32 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 1073741824" returned: 0 in 1.427s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:33 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 Jun 23 13:55:33 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:33 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.520s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:55:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:55:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:55:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:55:34 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747" returned: 0 in 1.192s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] <== create_volume: return (2691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.695s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573c0742-8105-4f2a-afc0-25c90fb80b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72dca016-d05e-474f-ac11-7c23314eb747', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91b1fcc-d77f-4323-9c88-d1385aebb3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Volume volume-72dca016-d05e-474f-ac11-7c23314eb747 (72dca016-d05e-474f-ac11-7c23314eb747): created successfully Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91b1fcc-d77f-4323-9c88-d1385aebb3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Flow 'volume_create_manager' (06fc240f-436d-422f-abc3-afae952df207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:34 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d06b7eff-bf87-44ea-8437-06bc449ad526 tempest-VolumesAdminNegativeTest-1711868241 None] Created volume successfully. Jun 23 13:55:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Acquiring lock "cinder-72dca016-d05e-474f-ac11-7c23314eb747-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:55:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "cinder-72dca016-d05e-474f-ac11-7c23314eb747-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:55:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Acquiring lock "cinder-quobyte-72dca016-d05e-474f-ac11-7c23314eb747" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:55:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "cinder-quobyte-72dca016-d05e-474f-ac11-7c23314eb747" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:55:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa7a246-e47c-412b-b56b-cc9cdfcc2e61]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:55:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:35 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 Jun 23 13:55:35 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:36 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747" returned: 0 in 1.024s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:36 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747 Jun 23 13:55:36 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:37 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-72dca016-d05e-474f-ac11-7c23314eb747" returned: 0 in 1.060s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "cinder-quobyte-72dca016-d05e-474f-ac11-7c23314eb747" released by "delete_volume" :: held 2.185s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:55:37 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Created reservations ['da0c2f81-a44a-4850-89ec-7b9290064437', '3323db6d-24c7-4b7d-832b-c39bafed7dd4', 'b6a9518f-f138-4215-9e0f-4ec669c78400', 'b777741f-a321-4ad4-88c3-1237cd5a7c07'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:55:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:38 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:55:38 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:39 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.266s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:39 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:55:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Deleted volume successfully. Jun 23 13:55:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3828d627-7733-4c44-b843-c34c012a4078 tempest-VolumesAdminNegativeTest-1711868241 None] Lock "cinder-72dca016-d05e-474f-ac11-7c23314eb747-delete_volume" released by "delete_volume" :: held 4.033s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:55:40 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-6558e8fe-0a08-4fbd-9051-d9afd13ad6f2 tempest-ServerActionsTestOtherA-1739418772 None] Terminate volume connection completed successfully. Jun 23 13:55:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-6558e8fe-0a08-4fbd-9051-d9afd13ad6f2 tempest-ServerActionsTestOtherA-1739418772 None] Deleting attachment e625ab15-1794-4945-bb3f-e305d4294ea5. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:55:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf8b233-0dd3-4b06-9b62-c0d369b15876]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:55:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:43 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 Jun 23 13:55:43 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:44 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04" returned: 0 in 0.996s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.041s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-43b9756c-3c61-4d70-b210-4a3c7d105a04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78def527-95c1-4b31-8d98-d58e66113832', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:55:44 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-6529590f-3e86-401e-bdb1-01aa72f5b947 req-0bb04472-5916-44e3-a13e-a8fabf67f457 tempest-ServerActionsTestOtherA-1739418772 None] attachment_update completed successfully. Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Flow 'volume_create_manager' (e4b3d631-edf7-433f-9475-dfd7bda8fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55539aa2-c71b-4229-b342-99ab9780a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55539aa2-c71b-4229-b342-99ab9780a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-280452612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee63ddf-dd8e-4826-aca8-e463f5e89792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295130c86b2b4f5ea7b3945140a50337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:46Z,use_quota=True,user_id='4ab7899591f44d09b06e5967feabf0cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cd66d26-f6c0-4ff7-bfeb-a72d80530831),volume_type_id=1cd66d26-f6c0-4ff7-bfeb-a72d80530831)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c874fa1e-c487-44b0-8f7c-850ce3358501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c874fa1e-c487-44b0-8f7c-850ce3358501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420d8692-3002-48ab-b8db-5570cba6bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420d8692-3002-48ab-b8db-5570cba6bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee63ddf-dd8e-4826-aca8-e463f5e89792', 'volume_name': 'volume-dee63ddf-dd8e-4826-aca8-e463f5e89792', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3479bf8-5b6c-46db-b72c-4b2531f980cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3479bf8-5b6c-46db-b72c-4b2531f980cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a72876-8378-46ac-9986-f1fb498770f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Volume dee63ddf-dd8e-4826-aca8-e463f5e89792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee63ddf-dd8e-4826-aca8-e463f5e89792', 'volume_size': 1} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-280452612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee63ddf-dd8e-4826-aca8-e463f5e89792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295130c86b2b4f5ea7b3945140a50337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:46Z,use_quota=True,user_id='4ab7899591f44d09b06e5967feabf0cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cd66d26-f6c0-4ff7-bfeb-a72d80530831),volume_type_id=1cd66d26-f6c0-4ff7-bfeb-a72d80530831)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Creating volume dee63ddf-dd8e-4826-aca8-e463f5e89792 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:55:46 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:55:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:46 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 1073741824 Jun 23 13:55:46 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:47 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 1073741824" returned: 0 in 0.865s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:47 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 Jun 23 13:55:47 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:47 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792" returned: 0 in 0.804s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a72876-8378-46ac-9986-f1fb498770f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee63ddf-dd8e-4826-aca8-e463f5e89792', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d4e94a-c7fd-4549-a591-99a20d42faf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:47 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Volume volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 (dee63ddf-dd8e-4826-aca8-e463f5e89792): created successfully Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d4e94a-c7fd-4549-a591-99a20d42faf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Flow 'volume_create_manager' (e4b3d631-edf7-433f-9475-dfd7bda8fb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-706e8cc8-a694-491c-8cd1-45198644b237 tempest-VolumeTypesAccessTest-1076081656 None] Created volume successfully. Jun 23 13:55:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Acquiring lock "cinder-dee63ddf-dd8e-4826-aca8-e463f5e89792-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:55:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Lock "cinder-dee63ddf-dd8e-4826-aca8-e463f5e89792-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:55:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Acquiring lock "cinder-quobyte-dee63ddf-dd8e-4826-aca8-e463f5e89792" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:55:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Lock "cinder-quobyte-dee63ddf-dd8e-4826-aca8-e463f5e89792" acquired by "delete_volume" :: waited 0.066s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:55:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f8bca5-f2fd-4223-9d4b-897cbeaabe60]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:55:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:48 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 Jun 23 13:55:48 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:49 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792" returned: 0 in 0.877s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:49 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792 Jun 23 13:55:49 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:50 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dee63ddf-dd8e-4826-aca8-e463f5e89792" returned: 0 in 1.498s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Lock "cinder-quobyte-dee63ddf-dd8e-4826-aca8-e463f5e89792" released by "delete_volume" :: held 2.453s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:55:50 devstack cinder-volume[93689]: WARNING cinder.quota [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1520895141 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1520895141, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:55:50 devstack cinder-volume[93689]: WARNING cinder.quota [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1520895141 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1520895141, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:55:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Created reservations ['6b7acc6d-a908-4325-831b-05aa9eafd616', 'b92d0997-2bef-465e-ad43-50f77fe9d520', '6dd553bf-adb1-4d0d-aecf-d19fa64d59f8', '40e140e9-134e-4990-a5e6-32d756c4fcc3'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:55:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:51 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:55:51 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:52 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.417s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:52 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:55:52 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Deleted volume successfully. Jun 23 13:55:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b53e7da-9eef-483c-a411-c3fcb355643d tempest-VolumeTypesAccessTest-1076081656 None] Lock "cinder-dee63ddf-dd8e-4826-aca8-e463f5e89792-delete_volume" released by "delete_volume" :: held 4.355s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:01 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:56:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=33,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=4 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:56:25 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d9cc01c4-d756-4c10-9f3c-6edd01b8b1f6 req-8f8bd53e-c0c0-4b90-a412-75d118201d76 tempest-ServerActionsTestOtherA-1739418772 None] Terminate volume connection completed successfully. Jun 23 13:56:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-d9cc01c4-d756-4c10-9f3c-6edd01b8b1f6 req-8f8bd53e-c0c0-4b90-a412-75d118201d76 tempest-ServerActionsTestOtherA-1739418772 None] Deleting attachment 78def527-95c1-4b31-8d98-d58e66113832. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:32 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:56:32 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:33 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.910s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:56:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:56:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:56:35 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:56:35 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:56:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "cinder-43b9756c-3c61-4d70-b210-4a3c7d105a04-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Lock "cinder-43b9756c-3c61-4d70-b210-4a3c7d105a04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "cinder-quobyte-43b9756c-3c61-4d70-b210-4a3c7d105a04" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Lock "cinder-quobyte-43b9756c-3c61-4d70-b210-4a3c7d105a04" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:38 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce3ec9-f787-4f74-ac6f-bd482f52c5d4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:38 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 Jun 23 13:56:38 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:39 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04" returned: 0 in 0.925s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:39 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04 Jun 23 13:56:39 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:40 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-43b9756c-3c61-4d70-b210-4a3c7d105a04" returned: 0 in 0.787s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Lock "cinder-quobyte-43b9756c-3c61-4d70-b210-4a3c7d105a04" released by "delete_volume" :: held 1.790s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Created reservations ['885767f2-380a-4cf2-9c0f-0d9498612e41', '93229c7b-b54d-419b-9ad1-9014358f6ea7', 'b9369d68-3466-4bdd-a2bb-5870166bad4d', 'f2bfa7d3-551d-4e08-a6c5-190e88122c74'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:40 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:56:40 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:41 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.856s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:41 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Deleted volume successfully. Jun 23 13:56:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ba07e6c-5371-4f9f-95c4-eb37f4fd5209 tempest-ServerActionsTestOtherA-1739418772 None] Lock "cinder-43b9756c-3c61-4d70-b210-4a3c7d105a04-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d57f674-790b-4e1b-9331-1ec447c71f1d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:43 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 Jun 23 13:56:43 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:44 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770" returned: 0 in 1.002s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.034s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-26b884a6-30ca-4cee-845a-5829f12bb770', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbe60621-300b-4dae-84f3-d03c53ff52bf', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:56:44 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-b7441d40-0323-411e-bd44-1aab30a9ef13 req-4d538d77-12d1-4a6c-a998-a747e8857d7b tempest-TaggedAttachmentsTest-711185332 None] attachment_update completed successfully. Jun 23 13:56:52 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-6346a287-c403-4fbf-82a3-6fff2423dae6 req-b16c97f6-cf85-4b05-b387-88d814b824fb tempest-TaggedAttachmentsTest-711185332 None] Terminate volume connection completed successfully. Jun 23 13:56:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6346a287-c403-4fbf-82a3-6fff2423dae6 req-b16c97f6-cf85-4b05-b387-88d814b824fb tempest-TaggedAttachmentsTest-711185332 None] Deleting attachment cbe60621-300b-4dae-84f3-d03c53ff52bf. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:57:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:57:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (514780c3-241a-4458-9e9f-886c3b824f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e875307f-2a68-4c83-bbcf-941914e72277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e875307f-2a68-4c83-bbcf-941914e72277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-320958824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177dc55f-83b4-42be-89b9-09ed84af3c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:08Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82566063-21e9-4adb-8f5f-b8044eb39012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82566063-21e9-4adb-8f5f-b8044eb39012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf805fa-37a6-4a96-9f14-dce9e1c54361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf805fa-37a6-4a96-9f14-dce9e1c54361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177dc55f-83b4-42be-89b9-09ed84af3c77', 'volume_name': 'volume-177dc55f-83b4-42be-89b9-09ed84af3c77', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c047403-1981-441d-b6aa-cafc57cb7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c047403-1981-441d-b6aa-cafc57cb7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a4cd1-b469-4aff-ae91-380aafc6dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Volume 177dc55f-83b4-42be-89b9-09ed84af3c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177dc55f-83b4-42be-89b9-09ed84af3c77', 'volume_size': 1} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-320958824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177dc55f-83b4-42be-89b9-09ed84af3c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:08Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Creating volume 177dc55f-83b4-42be-89b9-09ed84af3c77 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:08 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:08 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 1073741824 Jun 23 13:57:08 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:09 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 1073741824" returned: 0 in 1.588s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:10 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 Jun 23 13:57:10 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:11 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77" returned: 0 in 1.103s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] <== create_volume: return (2782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.785s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87a4cd1-b469-4aff-ae91-380aafc6dd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177dc55f-83b4-42be-89b9-09ed84af3c77', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f313437-00fa-430b-b79c-4debd0dc9ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Volume volume-177dc55f-83b4-42be-89b9-09ed84af3c77 (177dc55f-83b4-42be-89b9-09ed84af3c77): created successfully Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f313437-00fa-430b-b79c-4debd0dc9ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (514780c3-241a-4458-9e9f-886c3b824f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-043c0cc2-c94c-4ebe-ad32-85620b232d8e tempest-VolumesActionsTest-435090029 None] Created volume successfully. Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea621dca-8c6d-4ab2-be78-122303480d19 tempest-VolumesActionsTest-435090029 None] Acquiring lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77" by "attach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea621dca-8c6d-4ab2-be78-122303480d19 tempest-VolumesActionsTest-435090029 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77" acquired by "attach_volume" :: waited 0.052s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ea621dca-8c6d-4ab2-be78-122303480d19 tempest-VolumesActionsTest-435090029 None] Attaching volume 177dc55f-83b4-42be-89b9-09ed84af3c77 to instance e866ed3b-49b6-4d45-b682-2f314c7715e3 at mountpoint /dev/vdb on host None. Jun 23 13:57:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ea621dca-8c6d-4ab2-be78-122303480d19 tempest-VolumesActionsTest-435090029 None] Attach volume completed successfully. Jun 23 13:57:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea621dca-8c6d-4ab2-be78-122303480d19 tempest-VolumesActionsTest-435090029 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77" released by "attach_volume" :: held 0.355s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:14 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-95aa971c-2c21-44e8-9d57-8ca97eceb70b tempest-VolumesActionsTest-236034314 None] Terminate volume connection completed successfully. Jun 23 13:57:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-95aa971c-2c21-44e8-9d57-8ca97eceb70b tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-detach_volume" by "detach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-95aa971c-2c21-44e8-9d57-8ca97eceb70b tempest-VolumesActionsTest-236034314 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-95aa971c-2c21-44e8-9d57-8ca97eceb70b tempest-VolumesActionsTest-236034314 None] Detaching volume 177dc55f-83b4-42be-89b9-09ed84af3c77 from instance e866ed3b-49b6-4d45-b682-2f314c7715e3. Jun 23 13:57:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-95aa971c-2c21-44e8-9d57-8ca97eceb70b tempest-VolumesActionsTest-236034314 None] Detach volume completed successfully. Jun 23 13:57:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-95aa971c-2c21-44e8-9d57-8ca97eceb70b tempest-VolumesActionsTest-236034314 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b12fca9-aaa2-4f18-8759-e07958412f0c tempest-VolumesActionsTest-435090029 None] Acquiring lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-detach_volume" by "detach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b12fca9-aaa2-4f18-8759-e07958412f0c tempest-VolumesActionsTest-435090029 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0b12fca9-aaa2-4f18-8759-e07958412f0c tempest-VolumesActionsTest-435090029 None] Volume detach called, but volume not attached. Jun 23 13:57:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b12fca9-aaa2-4f18-8759-e07958412f0c tempest-VolumesActionsTest-435090029 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Acquiring lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Acquiring lock "cinder-quobyte-177dc55f-83b4-42be-89b9-09ed84af3c77" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Lock "cinder-quobyte-177dc55f-83b4-42be-89b9-09ed84af3c77" acquired by "delete_volume" :: waited 0.040s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:17 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f44c9aa-4951-4ff9-8c64-247c926971f4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:17 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 Jun 23 13:57:17 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:18 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77" returned: 0 in 1.453s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:18 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77 Jun 23 13:57:18 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:20 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-177dc55f-83b4-42be-89b9-09ed84af3c77" returned: 0 in 1.300s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Lock "cinder-quobyte-177dc55f-83b4-42be-89b9-09ed84af3c77" released by "delete_volume" :: held 2.867s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Created reservations ['ceac72cd-4bed-4fcb-8874-f7da570bee27', '4f5ec335-88e3-4d16-b5b5-19978a710b36', '849d168c-ebb1-4b0a-97c2-a8f5aca41390', '9b0d0e5c-feda-4a84-99a9-e1d80cce5490'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:20 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:20 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Acquiring lock "cinder-26b884a6-30ca-4cee-845a-5829f12bb770-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Lock "cinder-26b884a6-30ca-4cee-845a-5829f12bb770-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:22 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.559s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Acquiring lock "cinder-quobyte-26b884a6-30ca-4cee-845a-5829f12bb770" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Deleted volume successfully. Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Lock "cinder-quobyte-26b884a6-30ca-4cee-845a-5829f12bb770" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-82f0e888-7c64-4c74-9a14-9b9a66bbb42a tempest-VolumesActionsTest-435090029 None] Lock "cinder-177dc55f-83b4-42be-89b9-09ed84af3c77-delete_volume" released by "delete_volume" :: held 5.040s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74a02f-fc44-46d7-a35b-0040cb164aee]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:22 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 Jun 23 13:57:22 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:23 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770" returned: 0 in 1.245s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:23 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770 Jun 23 13:57:23 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:24 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-26b884a6-30ca-4cee-845a-5829f12bb770" returned: 0 in 0.710s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Lock "cinder-quobyte-26b884a6-30ca-4cee-845a-5829f12bb770" released by "delete_volume" :: held 2.043s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Created reservations ['ccc04adf-49e0-47ff-973e-0e8acc5f0cdf', '45af94c6-6721-4958-b10a-53eb2f13144e', 'd90e382e-716d-49c6-b08f-393dd3062f4d', '28c28168-7506-43f0-9d3d-f1409f868eb2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:24 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:24 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:25 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.087s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:25 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:25 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Deleted volume successfully. Jun 23 13:57:25 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-98a2a85b-5326-4af2-ab35-31cbc2432614 tempest-TaggedAttachmentsTest-711185332 None] Lock "cinder-26b884a6-30ca-4cee-845a-5829f12bb770-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (f0920d78-c60c-40e2-9723-4dfef44c155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b56eb5a-7db0-40bd-b745-60e1758094e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b56eb5a-7db0-40bd-b745-60e1758094e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1752484523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d844ea75-054f-49ed-b22e-74927a2b924b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:31Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f467de4-c89d-47dc-9cfb-29faebb0402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f467de4-c89d-47dc-9cfb-29faebb0402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a029ecf2-eabc-4776-8379-061b4e35a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a029ecf2-eabc-4776-8379-061b4e35a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd844ea75-054f-49ed-b22e-74927a2b924b', 'volume_name': 'volume-d844ea75-054f-49ed-b22e-74927a2b924b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4789c63-c928-4a00-95bc-9865ae4d74a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4789c63-c928-4a00-95bc-9865ae4d74a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9973567-6ae4-4451-b4ff-481e2e72b2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Volume d844ea75-054f-49ed-b22e-74927a2b924b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d844ea75-054f-49ed-b22e-74927a2b924b', 'volume_size': 1} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1752484523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d844ea75-054f-49ed-b22e-74927a2b924b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:31Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Creating volume d844ea75-054f-49ed-b22e-74927a2b924b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:30 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:30 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b 1073741824 Jun 23 13:57:30 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Flow 'volume_create_manager' (5cc5ab5b-7ceb-46ff-9fdd-e41c352382e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09dafea-4d7b-49d7-88c0-5bdc4cc79e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09dafea-4d7b-49d7-88c0-5bdc4cc79e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-552342333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2329dad8ac314a728d5830eabf603116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:31Z,use_quota=True,user_id='65964de94e3142bebef63bc81ef82679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf09972-b168-45d1-b35a-010323bf36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf09972-b168-45d1-b35a-010323bf36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96a7104-4343-45e6-8cb2-a1ac9ab8dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96a7104-4343-45e6-8cb2-a1ac9ab8dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6', 'volume_name': 'volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eae3323-f762-4188-970b-ac32aae6ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eae3323-f762-4188-970b-ac32aae6ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06eb94c-8669-4306-8b15-4940f10cea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Volume 5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6', 'volume_size': 1} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:31 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b 1073741824" returned: 0 in 1.155s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:31 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b Jun 23 13:57:31 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:32 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:32 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:32 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b" returned: 0 in 0.904s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-552342333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2329dad8ac314a728d5830eabf603116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:31Z,use_quota=True,user_id='65964de94e3142bebef63bc81ef82679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Creating volume 5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:32 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9973567-6ae4-4451-b4ff-481e2e72b2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d844ea75-054f-49ed-b22e-74927a2b924b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d5d584-4454-4d4d-a2d1-67537955ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:32 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 1073741824 Jun 23 13:57:32 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Volume volume-d844ea75-054f-49ed-b22e-74927a2b924b (d844ea75-054f-49ed-b22e-74927a2b924b): created successfully Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d5d584-4454-4d4d-a2d1-67537955ded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (f0920d78-c60c-40e2-9723-4dfef44c155f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6c0ae862-d4e4-4346-8c43-f20fc92f8108 tempest-VolumesActionsTest-435090029 None] Created volume successfully. Jun 23 13:57:33 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.169s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:57:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:57:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-d844ea75-054f-49ed-b22e-74927a2b924b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-d844ea75-054f-49ed-b22e-74927a2b924b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-quobyte-d844ea75-054f-49ed-b22e-74927a2b924b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-d844ea75-054f-49ed-b22e-74927a2b924b" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:34 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 1073741824" returned: 0 in 1.421s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878cccd-f652-48c9-8a6f-30a3484ca230]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:34 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 Jun 23 13:57:34 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:34 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b Jun 23 13:57:34 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:35 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6" returned: 0 in 1.010s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] <== create_volume: return (2540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06eb94c-8669-4306-8b15-4940f10cea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca29f88-dd8f-43d0-a6c3-1ca5945d09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:35 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Volume volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 (5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6): created successfully Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca29f88-dd8f-43d0-a6c3-1ca5945d09a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Flow 'volume_create_manager' (5cc5ab5b-7ceb-46ff-9fdd-e41c352382e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:35 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-333a6562-d1ef-4ec5-9697-584931582840 tempest-ServersNegativeTestJSON-143735916 None] Created volume successfully. Jun 23 13:57:35 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b" returned: 0 in 1.512s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:35 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b Jun 23 13:57:35 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:36 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d844ea75-054f-49ed-b22e-74927a2b924b" returned: 0 in 1.011s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-d844ea75-054f-49ed-b22e-74927a2b924b" released by "delete_volume" :: held 2.589s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:36 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Created reservations ['c5f8bfae-bdde-4c92-b65c-3c1029b9df8a', '72dbe7a0-9054-4b53-a4b3-96bd00c9ae1f', '2e524ef8-2c10-478e-a119-59f7161a3d5f', '7918d1c1-92e1-4378-9eb4-66a62a02b8d5'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:37 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:37 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Flow 'volume_create_manager' (ff4d4035-651d-4bcb-af8a-9143a812c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4029f8-ffe9-416c-9e3f-28f7cf3f3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4029f8-ffe9-416c-9e3f-28f7cf3f3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-435671611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7187c16c-1f6d-4f63-9c42-88ecc22072d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2329dad8ac314a728d5830eabf603116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:38Z,use_quota=True,user_id='65964de94e3142bebef63bc81ef82679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e194c278-be25-4c68-8f79-45316324851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e194c278-be25-4c68-8f79-45316324851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19d6379-ca90-4b3d-8090-545502d59cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19d6379-ca90-4b3d-8090-545502d59cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7187c16c-1f6d-4f63-9c42-88ecc22072d3', 'volume_name': 'volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0be5b5-e3f4-4698-af72-344bee77a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0be5b5-e3f4-4698-af72-344bee77a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9aa47f-f598-4baf-b0f0-1500dfc97211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:37 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Volume 7187c16c-1f6d-4f63-9c42-88ecc22072d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3', 'volume_size': 1} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-435671611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7187c16c-1f6d-4f63-9c42-88ecc22072d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2329dad8ac314a728d5830eabf603116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:38Z,use_quota=True,user_id='65964de94e3142bebef63bc81ef82679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Creating volume 7187c16c-1f6d-4f63-9c42-88ecc22072d3 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:37 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:37 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:37 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 1073741824 Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.872s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:37 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:37 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:37 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Deleted volume successfully. Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ff8e98a-05d0-4b28-a81c-64539f79d5c6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-d844ea75-054f-49ed-b22e-74927a2b924b-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (74e2cbe8-7a21-4696-9308-ffc6eb42c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6daab8-688d-430b-81ba-604f1dbcada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6daab8-688d-430b-81ba-604f1dbcada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-43886210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478242a6-8c28-4505-b009-bba82b7df1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:38Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe82e53-88d5-42a3-8cfa-f55a6435a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe82e53-88d5-42a3-8cfa-f55a6435a80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e8ec96-e745-44d7-a2e9-fc0e885802fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e8ec96-e745-44d7-a2e9-fc0e885802fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478242a6-8c28-4505-b009-bba82b7df1e6', 'volume_name': 'volume-478242a6-8c28-4505-b009-bba82b7df1e6', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a247885-ef4d-457a-86d9-1a9da7630f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a247885-ef4d-457a-86d9-1a9da7630f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241c586-5a0c-4735-98a3-7b174bd4cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:38 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Volume 478242a6-8c28-4505-b009-bba82b7df1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478242a6-8c28-4505-b009-bba82b7df1e6', 'volume_size': 1} Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:38 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 1073741824" returned: 0 in 1.080s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:39 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 Jun 23 13:57:39 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:39 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3" returned: 0 in 0.856s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-43886210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478242a6-8c28-4505-b009-bba82b7df1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:38Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Creating volume 478242a6-8c28-4505-b009-bba82b7df1e6 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:39 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:39 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 1073741824 Jun 23 13:57:39 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9aa47f-f598-4baf-b0f0-1500dfc97211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2def00-4600-48ac-ba58-ae74b5fa46a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:39 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Volume volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 (7187c16c-1f6d-4f63-9c42-88ecc22072d3): created successfully Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2def00-4600-48ac-ba58-ae74b5fa46a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Flow 'volume_create_manager' (ff4d4035-651d-4bcb-af8a-9143a812c846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-897097d5-3234-4833-a478-c52102609e88 tempest-ServersNegativeTestJSON-143735916 None] Created volume successfully. Jun 23 13:57:40 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 1073741824" returned: 0 in 0.990s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:40 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 Jun 23 13:57:40 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "cinder-7187c16c-1f6d-4f63-9c42-88ecc22072d3-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-7187c16c-1f6d-4f63-9c42-88ecc22072d3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "cinder-quobyte-7187c16c-1f6d-4f63-9c42-88ecc22072d3" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-quobyte-7187c16c-1f6d-4f63-9c42-88ecc22072d3" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6" returned: 0 in 0.912s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:41 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab988a-c5e1-4d41-9561-d72f83c7cb34]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241c586-5a0c-4735-98a3-7b174bd4cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478242a6-8c28-4505-b009-bba82b7df1e6', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7522034d-3736-433a-a9c3-87bd3ad2225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:41 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Volume volume-478242a6-8c28-4505-b009-bba82b7df1e6 (478242a6-8c28-4505-b009-bba82b7df1e6): created successfully Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7522034d-3736-433a-a9c3-87bd3ad2225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (74e2cbe8-7a21-4696-9308-ffc6eb42c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-81c5f1ae-1726-4b85-88be-67e885ecd30c tempest-VolumesActionsTest-435090029 None] Created volume successfully. Jun 23 13:57:42 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 Jun 23 13:57:42 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:42 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Flow 'volume_create_manager' (904e5e79-a930-4488-92e1-ad64e8600d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664e0f54-04c1-4abe-bbe2-8f6b660356a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664e0f54-04c1-4abe-bbe2-8f6b660356a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1911125518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7e51fc-351d-4799-9d1d-659b3ca352e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527eddeedb3f4f83b2da13f8cfe8593a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:43Z,use_quota=True,user_id='bf7df5f2157d4bceabb86181c24fd803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb22f39-b1f1-4a67-ac48-cd066372f939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb22f39-b1f1-4a67-ac48-cd066372f939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495029d6-a116-42c9-8af3-a089357d6b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495029d6-a116-42c9-8af3-a089357d6b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7e51fc-351d-4799-9d1d-659b3ca352e7', 'volume_name': 'volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b10cd7-c539-40e1-af26-0b7a1481f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b10cd7-c539-40e1-af26-0b7a1481f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc9d067-53fb-4859-8cd5-0f486b7300fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:43 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Volume 0e7e51fc-351d-4799-9d1d-659b3ca352e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7', 'volume_size': 1} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1911125518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7e51fc-351d-4799-9d1d-659b3ca352e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527eddeedb3f4f83b2da13f8cfe8593a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:43Z,use_quota=True,user_id='bf7df5f2157d4bceabb86181c24fd803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Creating volume 0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:43 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:43 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 1073741824 Jun 23 13:57:43 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-478242a6-8c28-4505-b009-bba82b7df1e6-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Lock "cinder-478242a6-8c28-4505-b009-bba82b7df1e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-quobyte-478242a6-8c28-4505-b009-bba82b7df1e6" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-478242a6-8c28-4505-b009-bba82b7df1e6" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac11127-59e9-4cc3-97ca-816bdb511acd]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:43 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3" returned: 0 in 1.699s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:43 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3 Jun 23 13:57:43 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:43 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 Jun 23 13:57:43 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:44 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 1073741824" returned: 0 in 1.390s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:44 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-7187c16c-1f6d-4f63-9c42-88ecc22072d3" returned: 0 in 1.033s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:44 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 Jun 23 13:57:44 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-quobyte-7187c16c-1f6d-4f63-9c42-88ecc22072d3" released by "delete_volume" :: held 2.861s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:44 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6" returned: 0 in 1.154s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:44 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6 Jun 23 13:57:44 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Created reservations ['0f567f36-e790-4966-b870-a019acfd107a', 'dff24f4a-805a-4b9a-a93f-ff84dfa18756', '583a3881-ede2-4a47-b28f-b16e49de2bb3', 'ea1053c9-ffc1-497e-aa18-9f204d7a9c29'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:45 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:45 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "cinder-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "cinder-quobyte-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-quobyte-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6" acquired by "delete_volume" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:45 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09614f2-8f66-4ba7-b90c-9826e31e1007]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:45 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 Jun 23 13:57:45 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:46 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7" returned: 0 in 1.712s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] <== create_volume: return (3214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.217s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:46 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc9d067-53fb-4859-8cd5-0f486b7300fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5158887-0268-486b-93e7-2d3dc6223230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.402s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Deleted volume successfully. Jun 23 13:57:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Volume volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 (0e7e51fc-351d-4799-9d1d-659b3ca352e7): created successfully Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5158887-0268-486b-93e7-2d3dc6223230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Flow 'volume_create_manager' (904e5e79-a930-4488-92e1-ad64e8600d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-6ef1eb5d-9a66-48d9-a908-f82ba6697ce3 req-141da933-6549-4a6b-b25f-a80071f82518 tempest-VolumesSnapshotsTestJSON-165972039 None] Created volume successfully. Jun 23 13:57:46 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f17a4b01-10e8-478e-8e59-5155c10ab8d7 tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-7187c16c-1f6d-4f63-9c42-88ecc22072d3-delete_volume" released by "delete_volume" :: held 4.936s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-478242a6-8c28-4505-b009-bba82b7df1e6" returned: 0 in 1.960s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-478242a6-8c28-4505-b009-bba82b7df1e6" released by "delete_volume" :: held 3.161s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Created reservations ['8807d87a-213a-4f75-8be4-3a47272fdfba', '9936929a-5b19-401d-b130-39317ceb0de1', '1ea4a171-f778-4953-bf3b-b5b1ea882888', '9ef9a9f1-cee0-4846-ac6b-8e23bb01df53'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:46 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:46 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:47 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6" returned: 0 in 1.307s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:47 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6 Jun 23 13:57:47 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Creating offline snapshot 74634cdd-4db3-4a76-b796-8063985e3560 of volume 0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00df929-53e6-443c-b53b-a787977e8147]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:47 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 Jun 23 13:57:47 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:48 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.413s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Deleted volume successfully. Jun 23 13:57:48 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6" returned: 0 in 1.339s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-quobyte-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6" released by "delete_volume" :: held 2.765s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-75202851-6fb1-4b1a-8461-4db1b5acae31 tempest-VolumesActionsTest-236034314 None] Lock "cinder-478242a6-8c28-4505-b009-bba82b7df1e6-delete_volume" released by "delete_volume" :: held 5.090s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Created reservations ['24212316-b500-4070-8fc3-7bf8acc6270c', '4fd4d3ac-7ada-41f7-aebd-0463f226184c', 'b1ca60fe-a5e7-4ce2-b5e4-0a01fb9906e5', 'bf312db4-f577-48b5-a870-6a5bc7ef9dd0'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:48 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:48 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:49 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (b38bde08-404e-4282-868c-dfc3c1a31a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ca456b-0671-412a-91cb-0528ff0fde98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7" returned: 0 in 1.878s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ca456b-0671-412a-91cb-0528ff0fde98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145617151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d87f084-42bf-48ae-979d-a204edc99fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:49Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c0cf8f-e2dd-46d3-a3e9-293fca16581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c0cf8f-e2dd-46d3-a3e9-293fca16581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1776b2d6-45a3-4604-9cea-7e7087e71ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1776b2d6-45a3-4604-9cea-7e7087e71ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d87f084-42bf-48ae-979d-a204edc99fe5', 'volume_name': 'volume-0d87f084-42bf-48ae-979d-a204edc99fe5', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6453f680-8a68-49f3-9861-0dea128b1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6453f680-8a68-49f3-9861-0dea128b1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3c4b58-84bc-4c56-82ff-c04428590879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:49 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Volume 0d87f084-42bf-48ae-979d-a204edc99fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d87f084-42bf-48ae-979d-a204edc99fe5', 'volume_size': 1} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:49 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 1G Jun 23 13:57:49 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:49 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.069s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:49 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Deleted volume successfully. Jun 23 13:57:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-59271000-8961-4991-958f-de6c0a9412da tempest-ServersNegativeTestJSON-143735916 None] Lock "cinder-5fe5ee6d-462f-4e47-9aa9-27fbbe38afa6-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:50 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 1G" returned: 0 in 1.053s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:50 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 Jun 23 13:57:50 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:51 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560" returned: 0 in 1.119s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:51 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 is being set with open permissions: ugo+rw Jun 23 13:57:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:51 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 Jun 23 13:57:51 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:52 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560" returned: 0 in 0.768s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:52 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info Jun 23 13:57:52 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:53 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info" returned: 0 in 0.808s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:53 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info is being set with open permissions: ugo+rw Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:53 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info Jun 23 13:57:53 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:53 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.info" returned: 0 in 0.721s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.505s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.477s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145617151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d87f084-42bf-48ae-979d-a204edc99fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:49Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Creating volume 0d87f084-42bf-48ae-979d-a204edc99fe5 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:53 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:53 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 1073741824 Jun 23 13:57:53 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-1571faea-f317-41b5-a29e-39b5e81ba094 req-cd827089-996d-4d47-bc84-5e72f279d15b tempest-VolumesSnapshotsTestJSON-165972039 None] Create snapshot completed successfully Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "cinder-74634cdd-4db3-4a76-b796-8063985e3560-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-74634cdd-4db3-4a76-b796-8063985e3560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "cinder-quobyte-0e7e51fc-351d-4799-9d1d-659b3ca352e7" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-quobyte-0e7e51fc-351d-4799-9d1d-659b3ca352e7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "cinder-quobyte-74634cdd-4db3-4a76-b796-8063985e3560" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-quobyte-74634cdd-4db3-4a76-b796-8063985e3560" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Deleting offline snapshot 74634cdd-4db3-4a76-b796-8063985e3560 of volume 0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] snapshot_file for this snap is: volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a9cdf-4da1-47d2-952d-3c6ba8ff595b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:54 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 Jun 23 13:57:54 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:54 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 1073741824" returned: 0 in 1.002s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:54 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 Jun 23 13:57:54 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:55 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560" returned: 0 in 0.920s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a54b429-7bd5-4411-9e5c-979dd2294262]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:55 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 Jun 23 13:57:55 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:55 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5" returned: 0 in 0.842s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3c4b58-84bc-4c56-82ff-c04428590879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d87f084-42bf-48ae-979d-a204edc99fe5', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd94c542-4025-4e83-8602-2e7fb11a027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Volume volume-0d87f084-42bf-48ae-979d-a204edc99fe5 (0d87f084-42bf-48ae-979d-a204edc99fe5): created successfully Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd94c542-4025-4e83-8602-2e7fb11a027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (b38bde08-404e-4282-868c-dfc3c1a31a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f0819ed4-a5f6-4366-b497-e48f4a06b55d tempest-VolumesActionsTest-435090029 None] Created volume successfully. Jun 23 13:57:56 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7" returned: 0 in 0.848s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:56 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 Jun 23 13:57:56 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-0d87f084-42bf-48ae-979d-a204edc99fe5-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Lock "cinder-0d87f084-42bf-48ae-979d-a204edc99fe5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-quobyte-0d87f084-42bf-48ae-979d-a204edc99fe5" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-0d87f084-42bf-48ae-979d-a204edc99fe5" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0dcf5-1f22-48e3-95d6-9009ec8eb657]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:57 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560" returned: 0 in 0.925s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:57 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560 Jun 23 13:57:57 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:57 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 Jun 23 13:57:57 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:57 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7.74634cdd-4db3-4a76-b796-8063985e3560" returned: 0 in 0.670s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-quobyte-74634cdd-4db3-4a76-b796-8063985e3560" released by "_delete_snapshot" :: held 3.504s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-quobyte-0e7e51fc-351d-4799-9d1d-659b3ca352e7" released by "delete_snapshot" :: held 3.535s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:57 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5" returned: 0 in 0.842s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:57 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5 Jun 23 13:57:57 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:57 devstack cinder-volume[93689]: WARNING cinder.quota [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:57:57 devstack cinder-volume[93689]: DEBUG cinder.quota [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Created reservations ['e4068dfc-1e0f-4640-a8d8-6ceda49af9b2', '2b01c6ee-ef81-4ca3-973a-f96e44da129a', 'eed3a009-b896-4c86-a9f3-7911a9dead12', 'a549d982-3bca-4dfa-8740-6ac1cbefee41'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Delete snapshot completed successfully. Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-360e3cce-7029-4009-91b4-ee976dc50ba9 req-d6207424-0bbc-4e19-87e6-8f216c45dcc8 tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-74634cdd-4db3-4a76-b796-8063985e3560-delete_snapshot" released by "delete_snapshot" :: held 3.753s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:58 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d87f084-42bf-48ae-979d-a204edc99fe5" returned: 0 in 0.710s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-0d87f084-42bf-48ae-979d-a204edc99fe5" released by "delete_volume" :: held 1.596s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Created reservations ['775207d5-8184-4f68-a729-7ed6c7ef38cf', '65d9e2de-8057-47fc-85ed-0159c4f1f980', '93d4edf6-0da5-4b5c-b4ce-d82e6f423ffd', '227edff1-00cf-4015-9e9f-36cb702dba53'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:58 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:57:58 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "cinder-0e7e51fc-351d-4799-9d1d-659b3ca352e7-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-0e7e51fc-351d-4799-9d1d-659b3ca352e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "cinder-quobyte-0e7e51fc-351d-4799-9d1d-659b3ca352e7" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-quobyte-0e7e51fc-351d-4799-9d1d-659b3ca352e7" acquired by "delete_volume" :: waited 0.044s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bb1c2f-f8e3-422a-a4e6-2f7586bf6eae]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:59 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 Jun 23 13:57:59 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:59 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.877s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:59 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Deleted volume successfully. Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cadc4e35-4cbf-468b-83f5-03c8591e6cf3 tempest-VolumesActionsTest-236034314 None] Lock "cinder-0d87f084-42bf-48ae-979d-a204edc99fe5-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (65706921-671c-4bcf-9b6d-65f828f44c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30546ae-37a9-449a-a98a-a38efd2a379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30546ae-37a9-449a-a98a-a38efd2a379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1697168073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:00Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351349b2-b787-460a-82f4-fe5097a973f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351349b2-b787-460a-82f4-fe5097a973f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3b6a6f-c217-4bc4-8697-ed1b9f2706ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3b6a6f-c217-4bc4-8697-ed1b9f2706ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5', 'volume_name': 'volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befa3be4-644d-401e-9d54-31809799b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befa3be4-644d-401e-9d54-31809799b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebc7a3c-4d02-44e2-b784-342bce57e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:59 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Volume ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5', 'volume_size': 1} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1697168073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:00Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Creating volume ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:59 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:57:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:59 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 1073741824 Jun 23 13:57:59 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:00 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7" returned: 0 in 1.114s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:00 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7 Jun 23 13:58:00 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:00 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e7e51fc-351d-4799-9d1d-659b3ca352e7" returned: 0 in 0.712s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-quobyte-0e7e51fc-351d-4799-9d1d-659b3ca352e7" released by "delete_volume" :: held 1.936s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG cinder.quota [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Created reservations ['51ce8c7e-5188-49e0-bf1e-caf8ed9bfabc', '762b21c3-4a1c-4e66-88fd-b1f593bfe329', '687aefc1-de64-4c7b-94dc-a02d45076a62', 'e9a32565-13d5-4b15-bdb1-4dea8a69f7ed'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:01 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 1073741824" returned: 0 in 1.139s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:01 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:01 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:01 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:01 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:02 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.855s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.manager [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Deleted volume successfully. Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-d15c470b-30cc-49c2-88e9-ccee4beddd8e req-52cbbcb8-5ed6-4f06-89d0-4f239b665d3f tempest-VolumesSnapshotsTestJSON-165972039 None] Lock "cinder-0e7e51fc-351d-4799-9d1d-659b3ca352e7-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:02 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5" returned: 0 in 0.958s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebc7a3c-4d02-44e2-b784-342bce57e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c93b403-eccd-4d9d-a330-eeb4250fb239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:02 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Volume volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 (ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5): created successfully Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c93b403-eccd-4d9d-a330-eeb4250fb239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (65706921-671c-4bcf-9b6d-65f828f44c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-24b99ac2-bfb1-4d8a-8545-3dd70872c449 tempest-VolumesActionsTest-435090029 None] Created volume successfully. Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=73,cinder:UPDATE=111,cinder:INSERT=25,cinder:DELETE=8 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=73,cinder:UPDATE=87,cinder:DELETE=9,cinder:INSERT=22 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Acquiring lock "cinder-quobyte-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5" acquired by "delete_volume" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8535c7-1447-4576-a92b-75a99970771b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:03 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 Jun 23 13:58:03 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:04 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5" returned: 0 in 0.895s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:04 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5 Jun 23 13:58:04 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:05 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5" returned: 0 in 0.934s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-quobyte-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5" released by "delete_volume" :: held 1.899s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Created reservations ['51be0efd-5a0c-44b3-a8c1-8a40b8bb51a2', 'b92c230a-f6d4-4835-b210-62583d3c8e5b', '1e70e16d-14bd-4abb-89ff-dd0d4f2b6ab3', '46d84abf-9a54-4915-a551-2cf6169e0d5e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:05 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:05 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:06 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (d3eb434c-e876-49ce-ba51-65f7531798ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fa6e67-c6f0-452f-a341-a6d67aa3d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.195s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fa6e67-c6f0-452f-a341-a6d67aa3d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264704865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:06Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34ccdc4-7467-4bb0-bb04-7273e51f3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34ccdc4-7467-4bb0-bb04-7273e51f3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8073ac04-94c8-4c57-9642-706a7073c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8073ac04-94c8-4c57-9642-706a7073c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2', 'volume_name': 'volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ffcc72-bd98-47fe-aa89-f7739fbf6bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ffcc72-bd98-47fe-aa89-f7739fbf6bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51064108-5c11-4209-903d-83c498d2f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Volume 0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2', 'volume_size': 1} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264704865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9954f87b6d8442a90c8a9bbf14f1dd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:06Z,use_quota=True,user_id='a231e66e3ab94b358b7f0ddfe634e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Creating volume 0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:06 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:06 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Deleted volume successfully. Jun 23 13:58:06 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 1073741824 Jun 23 13:58:06 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e4e8a07e-21bb-4864-80e1-5af1367c08b6 tempest-VolumesActionsTest-236034314 None] Lock "cinder-ad650e1f-6bf4-44d9-8e17-ab0f3e2c96d5-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:07 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 1073741824" returned: 0 in 1.200s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:07 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 Jun 23 13:58:07 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:08 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2" returned: 0 in 0.846s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51064108-5c11-4209-903d-83c498d2f596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93418b33-57a7-4e4e-bb64-f27c04171fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Volume volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 (0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2): created successfully Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93418b33-57a7-4e4e-bb64-f27c04171fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Flow 'volume_create_manager' (d3eb434c-e876-49ce-ba51-65f7531798ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:08 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a9ebfd03-6e09-4ef9-b9f2-1b31117c9e31 tempest-VolumesActionsTest-435090029 None] Created volume successfully. Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Flow 'volume_create_manager' (d73510aa-f69c-4b0d-8d7a-27c68890c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea9d7aa-b953-44d6-9a55-0aae2014245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea9d7aa-b953-44d6-9a55-0aae2014245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-372771090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81329655-1bac-4434-88f3-3feb792ecb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079b9a0a82fe40279ef353c621ae1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:09Z,use_quota=True,user_id='bc3ffbc72d5f4c69a56ece3d15ecc087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36d7129-006d-48fc-b29e-295b599e3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36d7129-006d-48fc-b29e-295b599e3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c92fb-d9b1-4a0c-a4a5-f43c8199e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c92fb-d9b1-4a0c-a4a5-f43c8199e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81329655-1bac-4434-88f3-3feb792ecb1e', 'volume_name': 'volume-81329655-1bac-4434-88f3-3feb792ecb1e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbf05d3-2df6-467a-9afa-5077cac67914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbf05d3-2df6-467a-9afa-5077cac67914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251cbd93-ee11-4e1b-bdbf-04bd27075196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Volume 81329655-1bac-4434-88f3-3feb792ecb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81329655-1bac-4434-88f3-3feb792ecb1e', 'volume_size': 1} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-372771090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81329655-1bac-4434-88f3-3feb792ecb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079b9a0a82fe40279ef353c621ae1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:09Z,use_quota=True,user_id='bc3ffbc72d5f4c69a56ece3d15ecc087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Creating volume 81329655-1bac-4434-88f3-3feb792ecb1e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:09 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:58:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:09 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e 1073741824 Jun 23 13:58:09 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Acquiring lock "cinder-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Lock "cinder-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Acquiring lock "cinder-quobyte-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Lock "cinder-quobyte-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2" acquired by "delete_volume" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c9d1f-7949-401a-8828-aa5fb56656a9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:10 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 Jun 23 13:58:10 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:10 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e 1073741824" returned: 0 in 1.252s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:11 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e Jun 23 13:58:11 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:11 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2" returned: 0 in 0.987s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:11 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2 Jun 23 13:58:11 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:11 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e" returned: 0 in 0.854s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251cbd93-ee11-4e1b-bdbf-04bd27075196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81329655-1bac-4434-88f3-3feb792ecb1e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e498e1-9fb5-49ed-8fcc-6761e23c19b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Volume volume-81329655-1bac-4434-88f3-3feb792ecb1e (81329655-1bac-4434-88f3-3feb792ecb1e): created successfully Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e498e1-9fb5-49ed-8fcc-6761e23c19b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Flow 'volume_create_manager' (d73510aa-f69c-4b0d-8d7a-27c68890c501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f422bd23-2355-4e94-a768-e97f3efb83aa tempest-AttachVolumeTestJSON-2132768425 None] Created volume successfully. Jun 23 13:58:12 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2" returned: 0 in 0.941s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Lock "cinder-quobyte-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2" released by "delete_volume" :: held 1.997s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Created reservations ['039d2dfe-3cde-4edc-9f49-96d6fc69a747', '7d3750a7-0306-4eff-b39c-c3017c67e759', 'c02f31aa-3dc8-4cdf-84b6-fc93a203e4d2', 'afab0a4a-918e-43a4-8a3b-775c76001bf2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8ec2ea85-fd61-4fd5-b60d-61b20a918ed5 tempest-BackendsCapabilitiesAdminTestsJSON-1234585349 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93689) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 13:58:12 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:12 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3d88ec0a-1c4a-487d-aba0-0cf5b492ada3 tempest-BackendsCapabilitiesAdminTestsJSON-1234585349 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93689) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 13:58:13 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.775s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:13 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Deleted volume successfully. Jun 23 13:58:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6e0f055d-ba02-4b43-a3f6-d4d3a59316c1 tempest-VolumesActionsTest-435090029 None] Lock "cinder-0391cdaf-8e6d-44fd-ad3d-e9f53c1422c2-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4126ac-c32c-4016-b392-6df588026cf2]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:16 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e Jun 23 13:58:16 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:17 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e" returned: 0 in 0.992s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-81329655-1bac-4434-88f3-3feb792ecb1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9c59ec0-3f56-473f-98ce-7bf6b9298467', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:58:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-877827c4-381f-403f-a270-ad1aa251324b req-9b7adfdb-bfad-4df1-a742-9f3a1d41d4e6 tempest-AttachVolumeTestJSON-2132768425 None] attachment_update completed successfully. Jun 23 13:58:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-aaca7fdd-1b43-43e9-92fe-33853ced48ca tempest-GroupsTest-1554791143 None] Group tempest-Group1-2144924300: creating Jun 23 13:58:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-aaca7fdd-1b43-43e9-92fe-33853ced48ca tempest-GroupsTest-1554791143 None] Group tempest-Group1-2144924300: created successfully Jun 23 13:58:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-aaca7fdd-1b43-43e9-92fe-33853ced48ca tempest-GroupsTest-1554791143 None] Create group completed successfully. Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:32 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:32 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1b262acd-9f8f-4963-ac7f-831be932cddb tempest-GroupsTest-1554791143 None] Group tempest-Group2-1992286641: creating Jun 23 13:58:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1b262acd-9f8f-4963-ac7f-831be932cddb tempest-GroupsTest-1554791143 None] Group tempest-Group2-1992286641: created successfully Jun 23 13:58:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1b262acd-9f8f-4963-ac7f-831be932cddb tempest-GroupsTest-1554791143 None] Create group completed successfully. Jun 23 13:58:33 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.835s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Flow 'volume_create_manager' (f3300504-d517-43e5-b8c6-41fcb8706961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ed7a6f-79bf-4b85-b875-1f5c7b7a7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ed7a6f-79bf-4b85-b875-1f5c7b7a7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1552571898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33a6ce2-3730-4e8c-b4db-9099395045c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5ea004bff7473a87b6e0a47691994e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:33Z,use_quota=True,user_id='29627ca9d5824eb49d031467cb69a950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72ef888-0a73-4df4-b3e2-0b7e09959179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72ef888-0a73-4df4-b3e2-0b7e09959179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fd6c1b-371e-4c11-bd5b-9e90f2e21152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fd6c1b-371e-4c11-bd5b-9e90f2e21152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33a6ce2-3730-4e8c-b4db-9099395045c0', 'volume_name': 'volume-b33a6ce2-3730-4e8c-b4db-9099395045c0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771d6275-96da-4f5c-a54e-d10439d41ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771d6275-96da-4f5c-a54e-d10439d41ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e23d22-da60-47f0-8593-d9fd3d55705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:33 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Volume b33a6ce2-3730-4e8c-b4db-9099395045c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33a6ce2-3730-4e8c-b4db-9099395045c0', 'volume_size': 1} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1552571898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33a6ce2-3730-4e8c-b4db-9099395045c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5ea004bff7473a87b6e0a47691994e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:33Z,use_quota=True,user_id='29627ca9d5824eb49d031467cb69a950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Creating volume b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:33 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:58:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:33 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 1073741824 Jun 23 13:58:33 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Flow 'volume_create_manager' (239831a8-bdaf-43f8-9166-ab99cc32ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28424421-1b6e-47fe-8e01-c16768734987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28424421-1b6e-47fe-8e01-c16768734987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1184042534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e0d292b-808d-407b-bafc-2f4e5f69e8e5,host='devstack@QuobyteHD#QuobyteHD',id=8ce07af1-67d6-4e7c-b5db-70103f5732e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda5587d4e62411a9588036e27515dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:34Z,use_quota=True,user_id='7e2adcbfbcd2458e8d4d5c41e205c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a46b9d8-601a-47e3-b510-d82fed9b4b5e),volume_type_id=4a46b9d8-601a-47e3-b510-d82fed9b4b5e)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8b653a-1960-4481-abf4-0e1c8282e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8b653a-1960-4481-abf4-0e1c8282e593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a65a09b-3d7c-4371-ae61-9ab8f8e64454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a65a09b-3d7c-4371-ae61-9ab8f8e64454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce07af1-67d6-4e7c-b5db-70103f5732e2', 'volume_name': 'volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77889f6-3273-49fc-a4e6-3a25176c28ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77889f6-3273-49fc-a4e6-3a25176c28ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62239f46-4085-481e-ad8d-4ae6b376ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Volume 8ce07af1-67d6-4e7c-b5db-70103f5732e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2', 'volume_size': 1} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:34 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 1073741824" returned: 0 in 1.375s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:34 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 Jun 23 13:58:34 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:35 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0" returned: 0 in 0.789s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e0d292b-808d-407b-bafc-2f4e5f69e8e5,created_at=2026-06-23T11:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1184042534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e0d292b-808d-407b-bafc-2f4e5f69e8e5,host='devstack@QuobyteHD#QuobyteHD',id=8ce07af1-67d6-4e7c-b5db-70103f5732e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda5587d4e62411a9588036e27515dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:34Z,use_quota=True,user_id='7e2adcbfbcd2458e8d4d5c41e205c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a46b9d8-601a-47e3-b510-d82fed9b4b5e),volume_type_id=4a46b9d8-601a-47e3-b510-d82fed9b4b5e)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Creating volume 8ce07af1-67d6-4e7c-b5db-70103f5732e2 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:35 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:35 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 1073741824 Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e23d22-da60-47f0-8593-d9fd3d55705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33a6ce2-3730-4e8c-b4db-9099395045c0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:35 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e99686e-38b6-48b7-bb46-85f7a402fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:35 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Volume volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 (b33a6ce2-3730-4e8c-b4db-9099395045c0): created successfully Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e99686e-38b6-48b7-bb46-85f7a402fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Flow 'volume_create_manager' (f3300504-d517-43e5-b8c6-41fcb8706961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:35 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-43be13d2-a491-4893-8874-5612287b74b4 tempest-SnapshotMetadataTestJSON-1443185457 None] Created volume successfully. Jun 23 13:58:36 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 1073741824" returned: 0 in 1.119s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:36 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 Jun 23 13:58:36 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:37 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2" returned: 0 in 0.677s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.724s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Creating offline snapshot 8193de0a-cd4b-4e90-97f0-a703bbd97d83 of volume b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62239f46-4085-481e-ad8d-4ae6b376ff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9739e00-2d3f-41be-aeba-ad2a14a52b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8058751b-6870-46ba-bd14-3063a619c1d0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:37 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Volume volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 (8ce07af1-67d6-4e7c-b5db-70103f5732e2): created successfully Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9739e00-2d3f-41be-aeba-ad2a14a52b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Flow 'volume_create_manager' (239831a8-bdaf-43f8-9166-ab99cc32ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:37 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-82d3b2b7-6f9c-45a5-9eef-c26a9508da24 tempest-GroupsTest-1554791143 None] Created volume successfully. Jun 23 13:58:37 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 Jun 23 13:58:37 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:39 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0" returned: 0 in 1.753s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:39 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 1G Jun 23 13:58:39 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Acquiring lock "cinder-quobyte-8ce07af1-67d6-4e7c-b5db-70103f5732e2" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Lock "cinder-quobyte-8ce07af1-67d6-4e7c-b5db-70103f5732e2" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:39 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[70903bdf-4129-49e8-841f-f398fb692ac1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:39 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 Jun 23 13:58:39 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:40 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 1G" returned: 0 in 1.195s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:40 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 Jun 23 13:58:40 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:40 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2" returned: 0 in 1.069s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:40 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2 Jun 23 13:58:40 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:41 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83" returned: 0 in 0.996s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:41 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 is being set with open permissions: ugo+rw Jun 23 13:58:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:41 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 Jun 23 13:58:41 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:41 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8ce07af1-67d6-4e7c-b5db-70103f5732e2" returned: 0 in 1.044s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Lock "cinder-quobyte-8ce07af1-67d6-4e7c-b5db-70103f5732e2" released by "delete_volume" :: held 2.227s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Created reservations ['587bc7b4-8943-49af-b36b-9247bf69ee63'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:42 devstack cinder-volume[93689]: WARNING cinder.quota [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-93438751 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-93438751, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:58:42 devstack cinder-volume[93689]: WARNING cinder.quota [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-93438751 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-93438751, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Created reservations ['dbc0615a-e544-4c4b-a963-d9f42473eac5', '4d793a97-b120-4342-96c7-c48e0e7df6b4', '26a79fcb-14e6-4e22-baa9-3d0fe710ef21', '815c48f7-c37d-44b2-91e8-e51b324abaa6'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:42 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:42 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:42 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83" returned: 0 in 0.910s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:42 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info Jun 23 13:58:42 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:42 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Created reservations ['69d890cb-a6c2-4dcc-aff2-7f1a8ffc7db6'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:43 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:43 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:44 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info" returned: 0 in 2.023s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:44 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info is being set with open permissions: ugo+rw Jun 23 13:58:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:44 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info Jun 23 13:58:44 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:44 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 2.284s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:44 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:44 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3094a9fb-a466-4953-a174-36e6d12f6762 tempest-GroupsTest-1554791143 None] Delete group completed successfully. Jun 23 13:58:45 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 2.379s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:45 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3881840d-a89a-4c89-803a-7827e29f10be tempest-GroupsTest-1554791143 None] Delete group completed successfully. Jun 23 13:58:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-88f497b8-e51f-43e8-ba5c-c71457924402 tempest-GroupsTest-1554791143 None] Group tempest-GroupsTest-Group-1683256636: creating Jun 23 13:58:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-88f497b8-e51f-43e8-ba5c-c71457924402 tempest-GroupsTest-1554791143 None] Group tempest-GroupsTest-Group-1683256636: created successfully Jun 23 13:58:45 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.info" returned: 0 in 1.126s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.185s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-88f497b8-e51f-43e8-ba5c-c71457924402 tempest-GroupsTest-1554791143 None] Create group completed successfully. Jun 23 13:58:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f32c4043-43d6-4eaf-862a-05739b5523d8 tempest-SnapshotMetadataTestJSON-1443185457 None] Create snapshot completed successfully Jun 23 13:58:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "cinder-8193de0a-cd4b-4e90-97f0-a703bbd97d83-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:47 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Flow 'volume_create_manager' (4e2c6865-18d6-4628-8210-91e509495783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2885c6db-897c-4f0a-b38f-168819b1ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-8193de0a-cd4b-4e90-97f0-a703bbd97d83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "cinder-quobyte-b33a6ce2-3730-4e8c-b4db-9099395045c0" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2885c6db-897c-4f0a-b38f-168819b1ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-553813438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7baf6e-b0c7-4911-a3f2-071c885d16e4,host='devstack@QuobyteHD#QuobyteHD',id=70df2c93-af64-4697-8e9c-e7aa9d8d2f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda5587d4e62411a9588036e27515dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:48Z,use_quota=True,user_id='7e2adcbfbcd2458e8d4d5c41e205c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90fd170e-5973-46d1-8344-f36b1583f435),volume_type_id=90fd170e-5973-46d1-8344-f36b1583f435)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1142783d-791d-4435-a4bd-860b138b068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1142783d-791d-4435-a4bd-860b138b068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8bf552-65e3-4b76-884d-8ba3c4bec936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8bf552-65e3-4b76-884d-8ba3c4bec936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70df2c93-af64-4697-8e9c-e7aa9d8d2f89', 'volume_name': 'volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1f2a89-d511-4f26-8a00-47ab2fc39ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c1f2a89-d511-4f26-8a00-47ab2fc39ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53d1be6-6141-46d3-b361-17d5aef1ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:48 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Volume 70df2c93-af64-4697-8e9c-e7aa9d8d2f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89', 'volume_size': 1} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7baf6e-b0c7-4911-a3f2-071c885d16e4,created_at=2026-06-23T11:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-553813438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7baf6e-b0c7-4911-a3f2-071c885d16e4,host='devstack@QuobyteHD#QuobyteHD',id=70df2c93-af64-4697-8e9c-e7aa9d8d2f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda5587d4e62411a9588036e27515dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:48Z,use_quota=True,user_id='7e2adcbfbcd2458e8d4d5c41e205c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90fd170e-5973-46d1-8344-f36b1583f435),volume_type_id=90fd170e-5973-46d1-8344-f36b1583f435)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Creating volume 70df2c93-af64-4697-8e9c-e7aa9d8d2f89 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:48 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-quobyte-b33a6ce2-3730-4e8c-b4db-9099395045c0" acquired by "delete_snapshot" :: waited 0.098s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "cinder-quobyte-8193de0a-cd4b-4e90-97f0-a703bbd97d83" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-quobyte-8193de0a-cd4b-4e90-97f0-a703bbd97d83" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:48 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 1073741824 Jun 23 13:58:48 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Deleting offline snapshot 8193de0a-cd4b-4e90-97f0-a703bbd97d83 of volume b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] snapshot_file for this snap is: volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be74168-e9c8-416b-88d4-668fc69a5574]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:48 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 Jun 23 13:58:48 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:49 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83" returned: 0 in 1.382s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b33a6ce2-3730-4e8c-b4db-9099395045c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:58:49 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 1073741824" returned: 0 in 1.516s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:49 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb55f35b-1dfd-40bc-af10-0ea897313329]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:49 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 Jun 23 13:58:49 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:49 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 Jun 23 13:58:49 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:50 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89" returned: 0 in 0.987s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] <== create_volume: return (2615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53d1be6-6141-46d3-b361-17d5aef1ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75703667-8890-4c73-b68a-884115ceed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:50 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Volume volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 (70df2c93-af64-4697-8e9c-e7aa9d8d2f89): created successfully Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75703667-8890-4c73-b68a-884115ceed43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Flow 'volume_create_manager' (4e2c6865-18d6-4628-8210-91e509495783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4f3f2fdb-cefa-4e95-ac29-f021f5bf6f1a tempest-GroupsTest-1554791143 None] Created volume successfully. Jun 23 13:58:51 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0" returned: 0 in 1.684s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:51 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 Jun 23 13:58:51 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:52 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83" returned: 0 in 0.943s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:52 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83 Jun 23 13:58:52 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:53 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0.8193de0a-cd4b-4e90-97f0-a703bbd97d83" returned: 0 in 1.108s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Flow 'volume_create_manager' (3189c56d-a4f4-4e29-8f46-2bf6cd5059b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01a0e2c-6eef-431f-8b01-0ce809905ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-quobyte-8193de0a-cd4b-4e90-97f0-a703bbd97d83" released by "_delete_snapshot" :: held 5.354s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-quobyte-b33a6ce2-3730-4e8c-b4db-9099395045c0" released by "delete_snapshot" :: held 5.390s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01a0e2c-6eef-431f-8b01-0ce809905ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566459107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7baf6e-b0c7-4911-a3f2-071c885d16e4,host='devstack@QuobyteHD#QuobyteHD',id=8062086b-4fb9-4fa9-a4ee-b45ba218b7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda5587d4e62411a9588036e27515dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:53Z,use_quota=True,user_id='7e2adcbfbcd2458e8d4d5c41e205c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90fd170e-5973-46d1-8344-f36b1583f435),volume_type_id=90fd170e-5973-46d1-8344-f36b1583f435)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed68486c-f375-4211-a71c-75d1c7415dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed68486c-f375-4211-a71c-75d1c7415dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d44bb13-b734-45c1-8037-65d94de7480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d44bb13-b734-45c1-8037-65d94de7480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8062086b-4fb9-4fa9-a4ee-b45ba218b7b0', 'volume_name': 'volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13382cb1-9639-4c33-9ad8-c3fb840604a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13382cb1-9639-4c33-9ad8-c3fb840604a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cff730-9043-4853-bb9c-f051f03bc7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:53 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Volume 8062086b-4fb9-4fa9-a4ee-b45ba218b7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0', 'volume_size': 1} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7baf6e-b0c7-4911-a3f2-071c885d16e4,created_at=2026-06-23T11:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566459107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7baf6e-b0c7-4911-a3f2-071c885d16e4,host='devstack@QuobyteHD#QuobyteHD',id=8062086b-4fb9-4fa9-a4ee-b45ba218b7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda5587d4e62411a9588036e27515dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:53Z,use_quota=True,user_id='7e2adcbfbcd2458e8d4d5c41e205c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90fd170e-5973-46d1-8344-f36b1583f435),volume_type_id=90fd170e-5973-46d1-8344-f36b1583f435)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Creating volume 8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:53 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:53 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 1073741824 Jun 23 13:58:53 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Created reservations ['60dfdc1e-ca80-41a7-87e7-eb9e5f550a8c', 'a7bb36ef-a745-42f0-9dd9-6a1706588efb', '983ff68b-de86-49f2-b613-ae79be2ac4e9', '2a2e897a-28ca-417e-9e51-1ff3c4ce9477'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Delete snapshot completed successfully. Jun 23 13:58:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-824bc314-f594-41b9-9bfc-d42cd8eff2e6 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-8193de0a-cd4b-4e90-97f0-a703bbd97d83-delete_snapshot" released by "delete_snapshot" :: held 5.712s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "cinder-b33a6ce2-3730-4e8c-b4db-9099395045c0-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-b33a6ce2-3730-4e8c-b4db-9099395045c0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "cinder-quobyte-b33a6ce2-3730-4e8c-b4db-9099395045c0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:54 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 1073741824" returned: 0 in 1.223s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-quobyte-b33a6ce2-3730-4e8c-b4db-9099395045c0" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b853f8-51d7-4c81-9266-78dfa532c57b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:54 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 Jun 23 13:58:54 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:54 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 Jun 23 13:58:54 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:55 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0" returned: 0 in 0.634s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cff730-9043-4853-bb9c-f051f03bc7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82c9178-6423-4aaf-8468-612a227ee616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Volume volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 (8062086b-4fb9-4fa9-a4ee-b45ba218b7b0): created successfully Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82c9178-6423-4aaf-8468-612a227ee616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Flow 'volume_create_manager' (3189c56d-a4f4-4e29-8f46-2bf6cd5059b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5a4e4d92-b751-4e8c-92cf-57041b9d29f5 tempest-GroupsTest-1554791143 None] Created volume successfully. Jun 23 13:58:55 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0" returned: 0 in 0.847s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:55 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0 Jun 23 13:58:55 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0166bada-32d7-4736-8737-0ac6aead0706 tempest-GroupsTest-1554791143 None] Update group completed successfully. Jun 23 13:58:56 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b33a6ce2-3730-4e8c-b4db-9099395045c0" returned: 0 in 0.659s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-quobyte-b33a6ce2-3730-4e8c-b4db-9099395045c0" released by "delete_volume" :: held 1.568s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Created reservations ['40317e8c-be18-476a-9f23-41bff3a1e700', '66c77eda-baf8-437f-8f72-bc62890cd8eb', 'da575286-9c04-4d61-ad7f-86689f380ad9', 'e025e82e-0537-4346-9092-f3ede58c09f2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:56 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:58:56 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:57 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.710s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:57 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Deleted volume successfully. Jun 23 13:58:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-516ef861-bc62-4ca9-8a21-1d37fd2ee9d1 tempest-SnapshotMetadataTestJSON-1443185457 None] Lock "cinder-b33a6ce2-3730-4e8c-b4db-9099395045c0-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9abcb11f-a423-4ac0-b328-a8c527f05e5b tempest-GroupsTest-1554791143 None] Update group completed successfully. Jun 23 13:58:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Acquiring lock "cinder-quobyte-70df2c93-af64-4697-8e9c-e7aa9d8d2f89" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Lock "cinder-quobyte-70df2c93-af64-4697-8e9c-e7aa9d8d2f89" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:59 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276f6d5-1ff0-4247-af56-2db321af6296]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:59 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 Jun 23 13:58:59 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:00 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89" returned: 0 in 0.978s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:00 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89 Jun 23 13:59:00 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:01 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-70df2c93-af64-4697-8e9c-e7aa9d8d2f89" returned: 0 in 0.699s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Lock "cinder-quobyte-70df2c93-af64-4697-8e9c-e7aa9d8d2f89" released by "delete_volume" :: held 1.773s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Acquiring lock "cinder-quobyte-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Lock "cinder-quobyte-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0" acquired by "delete_volume" :: waited 0.014s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:01 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce57f85-58bc-4211-ae4c-01e47db782a2]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:01 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 Jun 23 13:59:01 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:02 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0" returned: 0 in 0.931s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:02 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0 Jun 23 13:59:02 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:03 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0" returned: 0 in 0.848s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Lock "cinder-quobyte-8062086b-4fb9-4fa9-a4ee-b45ba218b7b0" released by "delete_volume" :: held 1.840s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Created reservations ['83b79969-b523-4c8f-9887-c127796d3fa6'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:03 devstack cinder-volume[93689]: WARNING cinder.quota [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1874952906 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1874952906, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:59:03 devstack cinder-volume[93689]: WARNING cinder.quota [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1874952906 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1874952906, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=61,cinder:INSERT=21,cinder:UPDATE=71,cinder:DELETE=5 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Created reservations ['7c37b30a-8948-46bf-be04-430275ef6906', '8ed74e51-99f7-4404-bc67-38c5104cf21e', 'e595ce1e-9552-4b98-a82b-febc7360a2bb', 'ac92160e-17e7-46ce-a6a8-b2f5f1341ba2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=78,cinder:INSERT=13,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Created reservations ['42f0a757-efe5-4295-99e4-ceab40ba471e', 'd1a0bc3d-69fe-4b95-a201-6a3b3a12d894', '64783f04-f0a6-46f7-a629-7f87497e49d0', 'a3f9529e-c4e0-4445-a299-c8272fe1ef01'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:03 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:03 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:04 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.681s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:04 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-849276e2-30f4-46f2-bb95-df5242b9a3a0 tempest-GroupsTest-1554791143 None] Delete group completed successfully. Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Flow 'volume_create_manager' (4121478c-1e27-4f8e-bab4-599f88dec8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bb2c9f-6b28-49cb-8a39-79d6000e197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bb2c9f-6b28-49cb-8a39-79d6000e197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-765401895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bea56ab-654e-4304-b71d-78c99cb91f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7bc763b8cf476e958f82de84409c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:05Z,use_quota=True,user_id='1dd7d475476143f7a4c11028b1844da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0392ee3-e64d-43bd-b020-d8de6f6a5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0392ee3-e64d-43bd-b020-d8de6f6a5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e986ac25-7832-463b-8ec5-3e35a3c81a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e986ac25-7832-463b-8ec5-3e35a3c81a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bea56ab-654e-4304-b71d-78c99cb91f4e', 'volume_name': 'volume-3bea56ab-654e-4304-b71d-78c99cb91f4e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36479362-e776-4fee-a79c-33ab5dbd8f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36479362-e776-4fee-a79c-33ab5dbd8f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be46b73-e042-41cb-a8d9-c091b85823c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Volume 3bea56ab-654e-4304-b71d-78c99cb91f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bea56ab-654e-4304-b71d-78c99cb91f4e', 'volume_size': 1} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-765401895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bea56ab-654e-4304-b71d-78c99cb91f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7bc763b8cf476e958f82de84409c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:05Z,use_quota=True,user_id='1dd7d475476143f7a4c11028b1844da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Creating volume 3bea56ab-654e-4304-b71d-78c99cb91f4e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:59:05 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:59:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:05 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e 1073741824 Jun 23 13:59:05 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:06 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e 1073741824" returned: 0 in 0.948s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:06 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e Jun 23 13:59:06 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:07 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e" returned: 0 in 0.836s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be46b73-e042-41cb-a8d9-c091b85823c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bea56ab-654e-4304-b71d-78c99cb91f4e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf9f560-8fcc-4ab7-a345-6a7c5eb5f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:07 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Volume volume-3bea56ab-654e-4304-b71d-78c99cb91f4e (3bea56ab-654e-4304-b71d-78c99cb91f4e): created successfully Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf9f560-8fcc-4ab7-a345-6a7c5eb5f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Flow 'volume_create_manager' (4121478c-1e27-4f8e-bab4-599f88dec8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:07 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5245b463-67b1-47a1-ab27-696885dc686e tempest-VolumesTransfersV355Test-1604761133 None] Created volume successfully. Jun 23 13:59:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-fa357ede-2899-4a8b-9834-cfe95dc3faa1 tempest-VolumesTransfersV355Test-1262751030 None] Transfer volume completed successfully. Jun 23 13:59:10 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-85221974-bf1c-4094-9bdb-47dd8156d356 tempest-GroupsV314Test-1731018973 None] Group tempest-GroupsV314Test-Group-1015646733: creating Jun 23 13:59:10 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-85221974-bf1c-4094-9bdb-47dd8156d356 tempest-GroupsV314Test-1731018973 None] Group tempest-GroupsV314Test-Group-1015646733: created successfully Jun 23 13:59:10 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-85221974-bf1c-4094-9bdb-47dd8156d356 tempest-GroupsV314Test-1731018973 None] Create group completed successfully. Jun 23 13:59:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Acquiring lock "cinder-3bea56ab-654e-4304-b71d-78c99cb91f4e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-3bea56ab-654e-4304-b71d-78c99cb91f4e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Acquiring lock "cinder-quobyte-3bea56ab-654e-4304-b71d-78c99cb91f4e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-quobyte-3bea56ab-654e-4304-b71d-78c99cb91f4e" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a81695-35a9-4224-8cc7-7aefdebd2cee]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:10 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e Jun 23 13:59:10 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:11 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e" returned: 0 in 0.935s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:11 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e Jun 23 13:59:11 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Flow 'volume_create_manager' (2680ee40-ed30-428b-8325-199537b80f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a690b3a4-f11e-49e5-a52b-f58561f69411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a690b3a4-f11e-49e5-a52b-f58561f69411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1774157295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0fbebd-145f-4701-a93f-6daf8ae8394b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a110044c354581b7dc4c23966c1aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:12Z,use_quota=True,user_id='368e7ad909f04ced974e6bb959f83b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf075cd-9756-4d8e-970a-d936c98081c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf075cd-9756-4d8e-970a-d936c98081c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324ecce7-bd55-4bde-a9ac-b3bbbf58be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324ecce7-bd55-4bde-a9ac-b3bbbf58be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0fbebd-145f-4701-a93f-6daf8ae8394b', 'volume_name': 'volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8a5180-2352-4936-9d8a-a34e24cca0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8a5180-2352-4936-9d8a-a34e24cca0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda377ec-686a-4b07-bc02-84942d4d0ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Volume bc0fbebd-145f-4701-a93f-6daf8ae8394b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b', 'volume_size': 1} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1774157295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0fbebd-145f-4701-a93f-6daf8ae8394b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a110044c354581b7dc4c23966c1aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:12Z,use_quota=True,user_id='368e7ad909f04ced974e6bb959f83b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Creating volume bc0fbebd-145f-4701-a93f-6daf8ae8394b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:59:11 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:59:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:12 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b 1073741824 Jun 23 13:59:12 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Flow 'volume_create_manager' (ceaa6b60-9179-441e-93cc-9a6ecc9d267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5da81b0-70f3-4642-89d5-7991118892c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5da81b0-70f3-4642-89d5-7991118892c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833444858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4d01dfe-edf8-4372-929a-2ae38e21e462,host='devstack@QuobyteHD#QuobyteHD',id=2142a6eb-c14c-4417-99d8-ea80096c7237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efb299cbca14ec7af071ed5d6455511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:12Z,use_quota=True,user_id='c0a63af6dc9946eea03790cabf93fbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50ad3c40-6ce8-4da2-bdb9-c72f18ac3b1e),volume_type_id=50ad3c40-6ce8-4da2-bdb9-c72f18ac3b1e)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cd5975-531f-40de-816f-8ce8be475a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cd5975-531f-40de-816f-8ce8be475a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522dda4f-fe16-4f45-97fe-a3ca1e9b0c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522dda4f-fe16-4f45-97fe-a3ca1e9b0c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2142a6eb-c14c-4417-99d8-ea80096c7237', 'volume_name': 'volume-2142a6eb-c14c-4417-99d8-ea80096c7237', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aeac3b8-0a2e-4f0c-a3ef-3e53c671dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aeac3b8-0a2e-4f0c-a3ef-3e53c671dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efc35d7-0a6c-4f8b-ac14-9fe59f271d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:12 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Volume 2142a6eb-c14c-4417-99d8-ea80096c7237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2142a6eb-c14c-4417-99d8-ea80096c7237', 'volume_size': 1} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:12 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3bea56ab-654e-4304-b71d-78c99cb91f4e" returned: 0 in 0.737s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-quobyte-3bea56ab-654e-4304-b71d-78c99cb91f4e" released by "delete_volume" :: held 1.726s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Created reservations ['f862b9a2-3e0f-4c51-bff1-c2658d0f060c', '335ba827-dec4-4711-a5cd-a4968e4e8cf3', 'db2d8da1-7638-4cc8-b984-1caf5ede9b59', '3d571e8b-bf94-4f96-a475-2799d7c3bb1b'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:12 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:12 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:13 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b 1073741824" returned: 0 in 1.052s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:13 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b Jun 23 13:59:13 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:13 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.784s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Deleted volume successfully. Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ff4e522-e4da-43df-bed5-81fcc7f484b5 tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-3bea56ab-654e-4304-b71d-78c99cb91f4e-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Flow 'volume_create_manager' (fe649488-6ce5-4a6a-8688-bd8675b2364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a9f4051-fa91-4ead-b13d-854cb0af24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a9f4051-fa91-4ead-b13d-854cb0af24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1070840808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4103fc9-4273-4301-89d8-0c6fe804db2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7bc763b8cf476e958f82de84409c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:14Z,use_quota=True,user_id='1dd7d475476143f7a4c11028b1844da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f407c3-0676-4efe-8d04-ed62519e3f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f407c3-0676-4efe-8d04-ed62519e3f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b6fb8e-3803-4952-b0a0-5484bd242fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b6fb8e-3803-4952-b0a0-5484bd242fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4103fc9-4273-4301-89d8-0c6fe804db2f', 'volume_name': 'volume-a4103fc9-4273-4301-89d8-0c6fe804db2f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7abb58e-a820-4c2f-836b-7cfeb975ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7abb58e-a820-4c2f-836b-7cfeb975ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6a5e54-728a-40da-a15b-ae81190ddaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Volume a4103fc9-4273-4301-89d8-0c6fe804db2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4103fc9-4273-4301-89d8-0c6fe804db2f', 'volume_size': 1} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:13 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b" returned: 0 in 0.740s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4d01dfe-edf8-4372-929a-2ae38e21e462,created_at=2026-06-23T11:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1833444858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4d01dfe-edf8-4372-929a-2ae38e21e462,host='devstack@QuobyteHD#QuobyteHD',id=2142a6eb-c14c-4417-99d8-ea80096c7237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efb299cbca14ec7af071ed5d6455511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:12Z,use_quota=True,user_id='c0a63af6dc9946eea03790cabf93fbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50ad3c40-6ce8-4da2-bdb9-c72f18ac3b1e),volume_type_id=50ad3c40-6ce8-4da2-bdb9-c72f18ac3b1e)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Creating volume 2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:59:13 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:13 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 1073741824 Jun 23 13:59:13 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda377ec-686a-4b07-bc02-84942d4d0ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77275cb5-493b-43ac-a0dd-353aa6d030c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Volume volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b (bc0fbebd-145f-4701-a93f-6daf8ae8394b): created successfully Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77275cb5-493b-43ac-a0dd-353aa6d030c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Flow 'volume_create_manager' (2680ee40-ed30-428b-8325-199537b80f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-591d006c-27b8-45a6-be56-2f094b508c29 tempest-AttachVolumeShelveTestJSON-1978033259 None] Created volume successfully. Jun 23 13:59:14 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 1073741824" returned: 0 in 0.886s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:14 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:14 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:15 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 0.664s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1070840808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4103fc9-4273-4301-89d8-0c6fe804db2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7bc763b8cf476e958f82de84409c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:14Z,use_quota=True,user_id='1dd7d475476143f7a4c11028b1844da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Creating volume a4103fc9-4273-4301-89d8-0c6fe804db2f {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:59:15 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efc35d7-0a6c-4f8b-ac14-9fe59f271d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2142a6eb-c14c-4417-99d8-ea80096c7237', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaa05eb-6f23-468a-812b-9c7e9e11294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:15 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f 1073741824 Jun 23 13:59:15 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:15 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Volume volume-2142a6eb-c14c-4417-99d8-ea80096c7237 (2142a6eb-c14c-4417-99d8-ea80096c7237): created successfully Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaa05eb-6f23-468a-812b-9c7e9e11294a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Flow 'volume_create_manager' (ceaa6b60-9179-441e-93cc-9a6ecc9d267b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7d60cc06-a9bd-4c8f-92e5-9d27a340f11d tempest-GroupsV314Test-1731018973 None] Created volume successfully. Jun 23 13:59:16 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f 1073741824" returned: 0 in 1.015s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:16 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f Jun 23 13:59:16 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:17 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f" returned: 0 in 0.728s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.222s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:17 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Cloning volume 2142a6eb-c14c-4417-99d8-ea80096c7237 to volume 8a56920e-4d51-4918-8634-683f277c6a2f Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6a5e54-728a-40da-a15b-ae81190ddaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4103fc9-4273-4301-89d8-0c6fe804db2f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdadbefe-c98d-4856-a915-ede2614f147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:17 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Volume volume-a4103fc9-4273-4301-89d8-0c6fe804db2f (a4103fc9-4273-4301-89d8-0c6fe804db2f): created successfully Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdadbefe-c98d-4856-a915-ede2614f147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Flow 'volume_create_manager' (fe649488-6ce5-4a6a-8688-bd8675b2364b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Creating offline snapshot f8c4937c-1be2-47c3-87ab-f7e2c99e18ef of volume 2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:59:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c3a662ae-b567-448c-a304-47b1a6be3d80 tempest-VolumesTransfersV355Test-1604761133 None] Created volume successfully. Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabb869f-f7aa-405f-b3f2-9e8544e9bea0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:17 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:17 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Acquiring lock "cinder-a4103fc9-4273-4301-89d8-0c6fe804db2f-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-a4103fc9-4273-4301-89d8-0c6fe804db2f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:18 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 1.238s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:18 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef 1G Jun 23 13:59:18 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Acquiring lock "cinder-quobyte-a4103fc9-4273-4301-89d8-0c6fe804db2f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-quobyte-a4103fc9-4273-4301-89d8-0c6fe804db2f" acquired by "delete_volume" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1208e498-3490-4594-b142-d06b1082a732]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:18 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f Jun 23 13:59:18 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:19 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef 1G" returned: 0 in 0.882s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2142a6eb-c14c-4417-99d8-ea80096c7237 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:19 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2142a6eb-c14c-4417-99d8-ea80096c7237 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef Jun 23 13:59:19 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:19 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f" returned: 0 in 0.828s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:19 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f Jun 23 13:59:19 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-dfbcb984-3775-4558-ae84-97ec26c7c721 req-8e3c5c5f-6d4f-479c-a21d-7c182e9a4683 tempest-AttachVolumeTestJSON-2132768425 None] Terminate volume connection completed successfully. Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-dfbcb984-3775-4558-ae84-97ec26c7c721 req-8e3c5c5f-6d4f-479c-a21d-7c182e9a4683 tempest-AttachVolumeTestJSON-2132768425 None] Deleting attachment d9c59ec0-3f56-473f-98ce-7bf6b9298467. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:59:20 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4103fc9-4273-4301-89d8-0c6fe804db2f" returned: 0 in 0.917s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-quobyte-a4103fc9-4273-4301-89d8-0c6fe804db2f" released by "delete_volume" :: held 1.804s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:20 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2142a6eb-c14c-4417-99d8-ea80096c7237 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" returned: 0 in 1.056s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:20 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:20 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef Jun 23 13:59:20 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Created reservations ['929d9ed2-e374-40cd-afeb-fbd3e198f7ab', '856f179e-94f9-4a18-ad1e-26bb6295ee38', 'acc90f12-a647-4721-bef1-5dde85256487', '31a4c603-f048-427f-be71-faf883b74355'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:20 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:20 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:21 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" returned: 0 in 0.775s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:21 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info Jun 23 13:59:21 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:21 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.843s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:21 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Deleted volume successfully. Jun 23 13:59:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d6a8ee01-40ae-431f-b17d-0e747cf0373d tempest-VolumesTransfersV355Test-552988591 None] Lock "cinder-a4103fc9-4273-4301-89d8-0c6fe804db2f-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:22 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info" returned: 0 in 0.956s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:59:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:22 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info Jun 23 13:59:22 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:23 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.info" returned: 0 in 0.832s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Acquiring lock "cinder-quobyte-8a56920e-4d51-4918-8634-683f277c6a2f" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-8a56920e-4d51-4918-8634-683f277c6a2f" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] snapshot: f8c4937c-1be2-47c3-87ab-f7e2c99e18ef, volume: 8a56920e-4d51-4918-8634-683f277c6a2f, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9276a3f6-1c4e-4c45-b5f8-fd9f1e944418]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:23 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef Jun 23 13:59:23 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:24 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" returned: 0 in 1.414s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2142a6eb-c14c-4417-99d8-ea80096c7237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 13:59:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 13:59:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e703129-3757-4cb3-bdbb-e766ea209187]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:24 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:24 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:25 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 1.211s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:25 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 13:59:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:25 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f Jun 23 13:59:25 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:31 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=36,cinder:UPDATE=42,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:59:31 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=50,cinder:SELECT=31,cinder:INSERT=12,cinder:DELETE=4 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:32 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:32 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f" returned: 0 in 7.245s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8947e721-af0f-494e-b03b-ec9841717fa5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:33 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:33 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:33 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.338s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:59:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:59:34 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 1.277s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:34 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:59:34 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Converted 1024.00 MB image at 141.31 MB/s Jun 23 13:59:34 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:59:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:34 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f Jun 23 13:59:34 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:35 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f" returned: 0 in 0.830s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-8a56920e-4d51-4918-8634-683f277c6a2f" released by "_copy_volume_from_snapshot" :: held 12.148s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Acquiring lock "cinder-quobyte-f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Deleting offline snapshot f8c4937c-1be2-47c3-87ab-f7e2c99e18ef of volume 2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] snapshot_file for this snap is: volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Flow 'volume_create_manager' (f4ca9b7c-e0ad-4537-9696-86d90dc10204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a573dcd-a4d2-4f46-8508-6eefc562698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc8959b-d7cb-4ca4-869c-2a18958c5cb1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a573dcd-a4d2-4f46-8508-6eefc562698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-929434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4565a5d5-f90c-45f7-be0f-e09046f76230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ea4eaa22343ec8312b65f6b5371f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:35Z,use_quota=True,user_id='42d70b45c1d44562ad9319f7dfe8393f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ff0be6-f3d5-4c0e-9f7c-0dabefb60019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ff0be6-f3d5-4c0e-9f7c-0dabefb60019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3da7ed2-e18f-48e8-ae7b-958f7a79ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3da7ed2-e18f-48e8-ae7b-958f7a79ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4565a5d5-f90c-45f7-be0f-e09046f76230', 'volume_name': 'volume-4565a5d5-f90c-45f7-be0f-e09046f76230', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a795f34-fa7b-49b3-8e10-bd898fbfc929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a795f34-fa7b-49b3-8e10-bd898fbfc929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65025384-53fa-44ac-b1ea-4a5b0044a064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:35 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Volume 4565a5d5-f90c-45f7-be0f-e09046f76230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4565a5d5-f90c-45f7-be0f-e09046f76230', 'volume_size': 1} Jun 23 13:59:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:35 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef Jun 23 13:59:35 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:36 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" returned: 0 in 0.890s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2142a6eb-c14c-4417-99d8-ea80096c7237(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:36 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c93ced9-20b0-41c5-8e30-c7e55ba46f40]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-f80519bf-907e-42fd-b06d-9627dba05ff3 req-2baf66bb-fdbe-4f4c-ac73-142ee0d1cf1a tempest-AttachVolumeShelveTestJSON-1978033259 None] No connector for attachment 5184c121-202f-404c-8a78-c6f20bc52510; skipping storage backend terminate_connection call. {{(pid=93689) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 13:59:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-f80519bf-907e-42fd-b06d-9627dba05ff3 req-2baf66bb-fdbe-4f4c-ac73-142ee0d1cf1a tempest-AttachVolumeShelveTestJSON-1978033259 None] Deleting attachment 5184c121-202f-404c-8a78-c6f20bc52510. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:59:36 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:36 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:37 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 1.305s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:37 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef Jun 23 13:59:37 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:38 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" returned: 0 in 1.035s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:38 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef Jun 23 13:59:38 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:39 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237.f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" returned: 0 in 0.838s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-f8c4937c-1be2-47c3-87ab-f7e2c99e18ef" released by "_delete_snapshot" :: held 4.320s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.554s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.250s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-929434913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4565a5d5-f90c-45f7-be0f-e09046f76230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ea4eaa22343ec8312b65f6b5371f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:35Z,use_quota=True,user_id='42d70b45c1d44562ad9319f7dfe8393f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Creating volume 4565a5d5-f90c-45f7-be0f-e09046f76230 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:59:39 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:59:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:39 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 1073741824 Jun 23 13:59:39 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-17e4ba2a-67fa-4285-92f0-474f95cdd334 tempest-GroupsV314Test-1731018973 None] Create group from source-group-c4d01dfe-edf8-4372-929a-2ae38e21e462 completed successfully. Jun 23 13:59:40 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 1073741824" returned: 0 in 0.946s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:40 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 Jun 23 13:59:40 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:41 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230" returned: 0 in 0.829s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65025384-53fa-44ac-b1ea-4a5b0044a064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4565a5d5-f90c-45f7-be0f-e09046f76230', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f3efe4-280a-464f-8789-078ed7dc0bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:41 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Volume volume-4565a5d5-f90c-45f7-be0f-e09046f76230 (4565a5d5-f90c-45f7-be0f-e09046f76230): created successfully Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f3efe4-280a-464f-8789-078ed7dc0bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Flow 'volume_create_manager' (f4ca9b7c-e0ad-4537-9696-86d90dc10204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b005b2e7-7369-414e-970e-068d8943d177 tempest-VolumesTransfersV357Test-735460914 None] Created volume successfully. Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Acquiring lock "cinder-quobyte-8a56920e-4d51-4918-8634-683f277c6a2f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-8a56920e-4d51-4918-8634-683f277c6a2f" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1b053-8af8-40d3-8287-94bcc2cad79a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:41 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f Jun 23 13:59:41 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-06ffd6cf-c443-44b6-861b-d1a10e939fd0 tempest-VolumesTransfersV357Test-2005200301 None] Transfer volume completed successfully. Jun 23 13:59:42 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f" returned: 0 in 0.961s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:42 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f Jun 23 13:59:42 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:43 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a56920e-4d51-4918-8634-683f277c6a2f" returned: 0 in 0.751s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-8a56920e-4d51-4918-8634-683f277c6a2f" released by "delete_volume" :: held 1.780s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Acquiring lock "cinder-4565a5d5-f90c-45f7-be0f-e09046f76230-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Created reservations ['25871142-881f-4e8d-afcc-9d9b480808a2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-4565a5d5-f90c-45f7-be0f-e09046f76230-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:43 devstack cinder-volume[93689]: WARNING cinder.quota [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-765187636 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-765187636, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:59:43 devstack cinder-volume[93689]: WARNING cinder.quota [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-765187636 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-765187636, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Acquiring lock "cinder-quobyte-4565a5d5-f90c-45f7-be0f-e09046f76230" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Created reservations ['26f4b3c1-d83c-4764-98de-1b9789e95d66', '6515b88f-002c-4c48-9033-07fb9db76259', '9b84e6d7-ccd3-4ac2-97c5-5eee066322c9', '70693ba1-0565-4b07-9bdb-0e0355dc6425'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-quobyte-4565a5d5-f90c-45f7-be0f-e09046f76230" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fbb85d-a4eb-451f-bbb1-87b5b5ebdab6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:43 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 Jun 23 13:59:43 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:44 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:44 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:44 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Acquiring lock "cinder-quobyte-2142a6eb-c14c-4417-99d8-ea80096c7237" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:44 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-2142a6eb-c14c-4417-99d8-ea80096c7237" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:44 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da426a-a6c8-46d3-8e68-da4eab5045c8]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:44 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:44 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:44 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230" returned: 0 in 1.162s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:45 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230 Jun 23 13:59:45 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:45 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.213s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:45 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5c8ca5cd-e1d2-4d2d-9d3b-f2ed57e81a6e tempest-GroupsV314Test-1731018973 None] Delete group completed successfully. Jun 23 13:59:46 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 1.414s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:46 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237 Jun 23 13:59:46 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:46 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4565a5d5-f90c-45f7-be0f-e09046f76230" returned: 0 in 1.262s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-quobyte-4565a5d5-f90c-45f7-be0f-e09046f76230" released by "delete_volume" :: held 2.490s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Created reservations ['ad485bca-c5ba-48e3-9a59-143054274a3a', 'db987c70-47d7-423e-8b20-4bb7a0559e95', 'a70046ef-64d2-4dcf-8dbe-0113c56cf994', '145ef5ac-0f46-4d59-9c21-0f269e48d16c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:46 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:46 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:47 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2142a6eb-c14c-4417-99d8-ea80096c7237" returned: 0 in 1.068s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Lock "cinder-quobyte-2142a6eb-c14c-4417-99d8-ea80096c7237" released by "delete_volume" :: held 2.583s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Created reservations ['54ce0d3f-d1e3-4887-8ae4-b178f067c2c0'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Created reservations ['87897125-3321-4131-8515-be1dc12a656a', '921a9706-3154-4d51-bd9f-79c59a6d9406', '95a2bb02-67f4-4e04-99cb-3e59c2667ad8', '62738f64-5931-4d77-bdf7-31a9740f1bce'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:47 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.112s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Deleted volume successfully. Jun 23 13:59:47 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:47 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f59a3e83-7e04-4ba1-841a-d0587e6abeea tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-4565a5d5-f90c-45f7-be0f-e09046f76230-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Flow 'volume_create_manager' (4da4b2eb-70c5-4678-85ae-984562e0e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc5117d-53ad-409f-b3d6-aa276984340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc5117d-53ad-409f-b3d6-aa276984340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2118878411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705d0336-1f71-4cc8-9f27-0e567412132a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ea4eaa22343ec8312b65f6b5371f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:48Z,use_quota=True,user_id='42d70b45c1d44562ad9319f7dfe8393f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fb8205-80ed-4589-b4b5-434f5d3ae82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fb8205-80ed-4589-b4b5-434f5d3ae82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7e7b0c-fcc4-446f-836d-7efd08bde3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7e7b0c-fcc4-446f-836d-7efd08bde3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705d0336-1f71-4cc8-9f27-0e567412132a', 'volume_name': 'volume-705d0336-1f71-4cc8-9f27-0e567412132a', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e113146-05d9-4939-8e0b-6a4249bd7adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e113146-05d9-4939-8e0b-6a4249bd7adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4267d59a-1ee4-43c1-8889-31429608f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:48 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Volume 705d0336-1f71-4cc8-9f27-0e567412132a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705d0336-1f71-4cc8-9f27-0e567412132a', 'volume_size': 1} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2118878411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705d0336-1f71-4cc8-9f27-0e567412132a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ea4eaa22343ec8312b65f6b5371f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:59:48Z,use_quota=True,user_id='42d70b45c1d44562ad9319f7dfe8393f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Creating volume 705d0336-1f71-4cc8-9f27-0e567412132a {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:59:48 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:48 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a 1073741824 Jun 23 13:59:48 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:48 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.041s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:48 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-19a40bc3-96a5-4520-a3c3-61ed0d8761b4 tempest-GroupsV314Test-1731018973 None] Delete group completed successfully. Jun 23 13:59:49 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a 1073741824" returned: 0 in 1.215s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:49 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a Jun 23 13:59:49 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:50 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a" returned: 0 in 1.235s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] <== create_volume: return (2572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:59:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4267d59a-1ee4-43c1-8889-31429608f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705d0336-1f71-4cc8-9f27-0e567412132a', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a7158a-c9d6-4d44-b693-20bf42959b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:59:51 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Volume volume-705d0336-1f71-4cc8-9f27-0e567412132a (705d0336-1f71-4cc8-9f27-0e567412132a): created successfully Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a7158a-c9d6-4d44-b693-20bf42959b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Flow 'volume_create_manager' (4da4b2eb-70c5-4678-85ae-984562e0e41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:59:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8f02c754-af97-48bf-8b44-b4b0b29bca62 tempest-VolumesTransfersV357Test-735460914 None] Created volume successfully. Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Acquiring lock "cinder-705d0336-1f71-4cc8-9f27-0e567412132a-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-705d0336-1f71-4cc8-9f27-0e567412132a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Acquiring lock "cinder-quobyte-705d0336-1f71-4cc8-9f27-0e567412132a" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-quobyte-705d0336-1f71-4cc8-9f27-0e567412132a" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d73042-2afe-4542-bb7a-8f10e271276b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:52 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a Jun 23 13:59:52 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:52 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a" returned: 0 in 0.928s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:52 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a Jun 23 13:59:52 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:53 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-705d0336-1f71-4cc8-9f27-0e567412132a" returned: 0 in 0.788s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-quobyte-705d0336-1f71-4cc8-9f27-0e567412132a" released by "delete_volume" :: held 1.764s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Created reservations ['b5b232e4-dd38-4a78-8769-3b16b5eb8e8f', '4bace846-90a6-46b4-931c-e715dba585d9', '200c518f-63d2-42b8-aea3-804783dd12a6', 'eabdeee3-a06f-4fac-a57b-8e55e8bf3801'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:53 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 13:59:53 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:54 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.887s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:54 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Deleted volume successfully. Jun 23 13:59:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11b1d378-1a61-4ea4-a586-4bb7335f3bb1 tempest-VolumesTransfersV357Test-1630053519 None] Lock "cinder-705d0336-1f71-4cc8-9f27-0e567412132a-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:02 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Flow 'volume_create_manager' (60e254bb-51a8-49cc-893d-f6f022676865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee40865-99e8-460c-ac0f-a36c00602590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee40865-99e8-460c-ac0f-a36c00602590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1586220462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb9fa9-2488-474e-a2b6-9d676ba4b2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c48a63f892d404bbc2a92859934e21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:03Z,use_quota=True,user_id='cb9d62faaa354e99a0ed72a65dc5a3e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378b7655-4f24-44a1-86cf-f573ed93336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378b7655-4f24-44a1-86cf-f573ed93336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0675505-c159-4e50-96cb-9a2f4d46a38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0675505-c159-4e50-96cb-9a2f4d46a38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cb9fa9-2488-474e-a2b6-9d676ba4b2b3', 'volume_name': 'volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3', 'volume_size': 2}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df75e88c-b92e-48be-a212-9ba7916ce017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df75e88c-b92e-48be-a212-9ba7916ce017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac001e07-2391-4582-aa6c-8ad49191bc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:03 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Volume 58cb9fa9-2488-474e-a2b6-9d676ba4b2b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3', 'volume_size': 2} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1586220462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb9fa9-2488-474e-a2b6-9d676ba4b2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c48a63f892d404bbc2a92859934e21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:03Z,use_quota=True,user_id='cb9d62faaa354e99a0ed72a65dc5a3e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Creating volume 58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:03 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:00:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 2147483648 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:03 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 2147483648 Jun 23 14:00:03 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:04 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 2147483648" returned: 0 in 1.398s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:04 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 Jun 23 14:00:04 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:05 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3" returned: 0 in 1.011s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac001e07-2391-4582-aa6c-8ad49191bc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3', 'volume_size': 2}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd422fff-d07c-438f-97e9-86fc516c086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Volume volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 (58cb9fa9-2488-474e-a2b6-9d676ba4b2b3): created successfully Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd422fff-d07c-438f-97e9-86fc516c086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Flow 'volume_create_manager' (60e254bb-51a8-49cc-893d-f6f022676865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:05 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-df63a29c-c2c1-4d30-b9b8-5d39c4f33095 tempest-VolumesCloneNegativeTest-806817101 None] Created volume successfully. Jun 23 14:00:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Acquiring lock "cinder-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Lock "cinder-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Acquiring lock "cinder-quobyte-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Lock "cinder-quobyte-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0214a16d-1634-4716-b4ca-461e4a2dd9dd]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:06 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 Jun 23 14:00:06 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:07 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Flow 'volume_create_manager' (cf83c040-2936-4b72-92d4-8c9edfe98ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117706c0-fbc3-4360-9436-6c364cc5cc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3" returned: 0 in 1.153s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117706c0-fbc3-4360-9436-6c364cc5cc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2058462361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567f3cb9-bfb3-4971-82fa-1c0175a12a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42171f96c5a4ffab7f0c0e8e323cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:08Z,use_quota=True,user_id='a37d86fddb4c48998e3281e256bb9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:07 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3 Jun 23 14:00:07 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873ef8a3-c397-44fb-bd72-40d2dac0b5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873ef8a3-c397-44fb-bd72-40d2dac0b5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78de0468-fd8d-4efd-b02b-188a3a880ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78de0468-fd8d-4efd-b02b-188a3a880ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567f3cb9-bfb3-4971-82fa-1c0175a12a98', 'volume_name': 'volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def38dbf-23c1-4ff7-88c5-25857f74cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def38dbf-23c1-4ff7-88c5-25857f74cd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e59e67-bf9c-4745-8fd0-befa474d51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:07 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Volume 567f3cb9-bfb3-4971-82fa-1c0175a12a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98', 'volume_size': 1} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2058462361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567f3cb9-bfb3-4971-82fa-1c0175a12a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42171f96c5a4ffab7f0c0e8e323cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:08Z,use_quota=True,user_id='a37d86fddb4c48998e3281e256bb9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Creating volume 567f3cb9-bfb3-4971-82fa-1c0175a12a98 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:07 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:00:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:07 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 1073741824 Jun 23 14:00:07 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:08 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3" returned: 0 in 0.743s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Lock "cinder-quobyte-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3" released by "delete_volume" :: held 1.941s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Created reservations ['2790f68b-a5de-401f-b4a9-a764cd26ffb6', 'a821a0a8-0697-473b-8344-1f681bba36b1', 'cba0e011-5815-4f9c-baa4-4a6cbb664324', 'b05da96e-4d62-4547-b0cd-87f10d83a66b'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:08 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:00:08 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:08 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 1073741824" returned: 0 in 1.142s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:08 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 Jun 23 14:00:08 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:09 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.082s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Deleted volume successfully. Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b110ae83-62ec-4e6d-b75f-edaa0c25f8ec tempest-VolumesCloneNegativeTest-806817101 None] Lock "cinder-58cb9fa9-2488-474e-a2b6-9d676ba4b2b3-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:09 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98" returned: 0 in 0.954s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e59e67-bf9c-4745-8fd0-befa474d51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d16fed0-7523-4f1c-b2ab-4cf5243cb4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Volume volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 (567f3cb9-bfb3-4971-82fa-1c0175a12a98): created successfully Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d16fed0-7523-4f1c-b2ab-4cf5243cb4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Flow 'volume_create_manager' (cf83c040-2936-4b72-92d4-8c9edfe98ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7ad03ea5-9850-4a95-9713-01cf5e1fff98 tempest-VolumeQuotasAdminTestJSON-218210335 None] Created volume successfully. Jun 23 14:00:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "cinder-567f3cb9-bfb3-4971-82fa-1c0175a12a98-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "cinder-567f3cb9-bfb3-4971-82fa-1c0175a12a98-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "cinder-quobyte-567f3cb9-bfb3-4971-82fa-1c0175a12a98" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "cinder-quobyte-567f3cb9-bfb3-4971-82fa-1c0175a12a98" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:11 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a28f73-25d7-418c-98c4-938932943729]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:11 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 Jun 23 14:00:11 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:12 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98" returned: 0 in 1.395s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:12 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98 Jun 23 14:00:12 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:13 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-567f3cb9-bfb3-4971-82fa-1c0175a12a98" returned: 0 in 1.421s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "cinder-quobyte-567f3cb9-bfb3-4971-82fa-1c0175a12a98" released by "delete_volume" :: held 2.879s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Created reservations ['6aff93ff-4a81-4342-86e8-9ff8ae5fca82', '4c3778c8-027d-4a64-b1f1-14611526dea2', '1668c428-a092-4ef1-a07d-a789dae9227f', '4b9707cf-7a74-400f-b9fd-63f5872928ce'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:14 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:00:14 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:15 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.857s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Deleted volume successfully. Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff367536-38e0-418d-837a-da2582492274 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "cinder-567f3cb9-bfb3-4971-82fa-1c0175a12a98-delete_volume" released by "delete_volume" :: held 4.124s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Flow 'volume_create_manager' (3442b31f-0153-4b04-87e8-1c2f46f81315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fd2250-37bd-45b4-88df-6552b68578d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fd2250-37bd-45b4-88df-6552b68578d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1665035128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30695bdc-018f-4b79-8f6b-d914e5562cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42171f96c5a4ffab7f0c0e8e323cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:15Z,use_quota=True,user_id='a37d86fddb4c48998e3281e256bb9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45472a8-23fa-4682-8979-188fc72291d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45472a8-23fa-4682-8979-188fc72291d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fdcc40-2578-4742-ad7b-d94cfe2f945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fdcc40-2578-4742-ad7b-d94cfe2f945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30695bdc-018f-4b79-8f6b-d914e5562cf2', 'volume_name': 'volume-30695bdc-018f-4b79-8f6b-d914e5562cf2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4a8113-a487-481c-adee-8f68b967fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4a8113-a487-481c-adee-8f68b967fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4250e764-df45-45a1-b203-f28d1d0e8b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:15 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Volume 30695bdc-018f-4b79-8f6b-d914e5562cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30695bdc-018f-4b79-8f6b-d914e5562cf2', 'volume_size': 1} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1665035128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30695bdc-018f-4b79-8f6b-d914e5562cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42171f96c5a4ffab7f0c0e8e323cc52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:15Z,use_quota=True,user_id='a37d86fddb4c48998e3281e256bb9c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Creating volume 30695bdc-018f-4b79-8f6b-d914e5562cf2 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:15 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:00:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:15 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 1073741824 Jun 23 14:00:15 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:16 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 1073741824" returned: 0 in 1.054s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:16 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 Jun 23 14:00:16 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Flow 'volume_create_manager' (25a3e72c-9f2c-4be8-b9ad-7270a2357172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2fd86c-8ed7-42d6-92a9-ff2fe29a7dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2fd86c-8ed7-42d6-92a9-ff2fe29a7dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1695200243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961c110f-1ede-4094-adbc-32f3c0031eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c82d307f7489788b875108a6b7b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:17Z,use_quota=True,user_id='d72e54f269b54ad0a43257d0ea75d62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3744528d-f57c-404e-9856-7c8ef2224442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3744528d-f57c-404e-9856-7c8ef2224442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37342eb6-8df6-480d-8a69-0d6304c116a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37342eb6-8df6-480d-8a69-0d6304c116a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961c110f-1ede-4094-adbc-32f3c0031eb4', 'volume_name': 'volume-961c110f-1ede-4094-adbc-32f3c0031eb4', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cd7ae3-cd7c-4649-a8f1-d70fcd8a0225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cd7ae3-cd7c-4649-a8f1-d70fcd8a0225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93756375-4354-44ee-bf64-7dd9d7d09712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:17 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Volume 961c110f-1ede-4094-adbc-32f3c0031eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961c110f-1ede-4094-adbc-32f3c0031eb4', 'volume_size': 1} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:17 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2" returned: 0 in 0.827s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1695200243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961c110f-1ede-4094-adbc-32f3c0031eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c82d307f7489788b875108a6b7b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:17Z,use_quota=True,user_id='d72e54f269b54ad0a43257d0ea75d62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Creating volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:17 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4250e764-df45-45a1-b203-f28d1d0e8b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30695bdc-018f-4b79-8f6b-d914e5562cf2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:17 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 1073741824 Jun 23 14:00:17 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3320dbe1-6d3d-4873-857e-773d2b6daf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:17 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Volume volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 (30695bdc-018f-4b79-8f6b-d914e5562cf2): created successfully Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3320dbe1-6d3d-4873-857e-773d2b6daf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Flow 'volume_create_manager' (3442b31f-0153-4b04-87e8-1c2f46f81315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6a308a6b-f9cd-4c61-b09d-2ec5a79fd278 tempest-VolumeQuotasAdminTestJSON-218210335 None] Created volume successfully. Jun 23 14:00:18 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 1073741824" returned: 0 in 0.990s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:18 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 Jun 23 14:00:18 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:19 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4" returned: 0 in 0.670s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93756375-4354-44ee-bf64-7dd9d7d09712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961c110f-1ede-4094-adbc-32f3c0031eb4', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a521b88-523c-4ce4-8c26-fa84e14d8ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:19 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4da42c23-986e-4418-83d4-6b315762000e tempest-VolumeQuotasAdminTestJSON-952304566 None] Transfer volume completed successfully. Jun 23 14:00:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Volume volume-961c110f-1ede-4094-adbc-32f3c0031eb4 (961c110f-1ede-4094-adbc-32f3c0031eb4): created successfully Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a521b88-523c-4ce4-8c26-fa84e14d8ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Flow 'volume_create_manager' (25a3e72c-9f2c-4be8-b9ad-7270a2357172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:19 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c7515a95-51da-4ecf-8a1c-d5cb589b535e tempest-VolumesSnapshotListTestJSON-1191940494 None] Created volume successfully. Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Creating offline snapshot 549b0f94-d83d-453f-b5fd-53fea8b62f05 of volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4749b-853d-4839-8bf9-55dfc2714883]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:19 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 Jun 23 14:00:19 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Acquiring lock "cinder-30695bdc-018f-4b79-8f6b-d914e5562cf2-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Lock "cinder-30695bdc-018f-4b79-8f6b-d914e5562cf2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Acquiring lock "cinder-quobyte-30695bdc-018f-4b79-8f6b-d914e5562cf2" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Lock "cinder-quobyte-30695bdc-018f-4b79-8f6b-d914e5562cf2" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41230e-0b77-4fb4-a192-549639889c7b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:20 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4" returned: 0 in 0.960s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:20 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 Jun 23 14:00:20 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:20 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 1G Jun 23 14:00:20 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:21 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2" returned: 0 in 0.925s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:21 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2 Jun 23 14:00:21 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:21 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 1G" returned: 0 in 0.917s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:21 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:21 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:22 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-30695bdc-018f-4b79-8f6b-d914e5562cf2" returned: 0 in 0.925s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Lock "cinder-quobyte-30695bdc-018f-4b79-8f6b-d914e5562cf2" released by "delete_volume" :: held 1.911s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Created reservations ['0dc31f5b-76fa-4f6e-904c-58c48774d247', '627d14a1-1011-4764-9053-2d158a78e32a', '08626cf7-7b1c-47a1-a36d-f0c4ddf13360', 'b38eede1-21af-4630-ab51-c900a53f7255'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:22 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:00:22 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:22 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 1.234s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 is being set with open permissions: ugo+rw Jun 23 14:00:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:22 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:22 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:24 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.658s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:24 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Deleted volume successfully. Jun 23 14:00:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-327d1104-422d-4e47-ad8b-d81acc4ac94b tempest-VolumeQuotasAdminTestJSON-747144364 None] Lock "cinder-30695bdc-018f-4b79-8f6b-d914e5562cf2-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:24 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 1.496s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:24 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info Jun 23 14:00:24 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:25 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info" returned: 0 in 1.034s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:25 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info is being set with open permissions: ugo+rw Jun 23 14:00:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:25 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info Jun 23 14:00:25 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:26 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.info" returned: 0 in 0.917s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.674s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-488518e2-e28f-4598-ad55-105e9ea9f658 tempest-VolumesSnapshotListTestJSON-1191940494 None] Create snapshot completed successfully Jun 23 14:00:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Creating offline snapshot 15ea18b6-5e0c-48a9-a18a-7b45485ef4bc of volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:00:27 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a9e364-6607-42a0-83fb-5753e3212d30]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:27 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:27 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:28 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 0.952s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:28 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc 1G Jun 23 14:00:28 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:29 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc 1G" returned: 0 in 0.993s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:29 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:29 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:30 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 0.812s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:30 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc is being set with open permissions: ugo+rw Jun 23 14:00:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:30 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:30 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:30 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 0.707s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.602s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-edb4fc15-a000-4ae6-96bb-34020d7565d7 tempest-VolumesSnapshotListTestJSON-1191940494 None] Create snapshot completed successfully Jun 23 14:00:31 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=61,cinder:UPDATE=80,cinder:DELETE=9,cinder:INSERT=22 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=92,cinder:SELECT=67,cinder:INSERT=15,cinder:DELETE=4 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Creating offline snapshot 3f57d8ca-125a-4ed9-8290-39ca9101d2c7 of volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ce813-68bc-46c1-9ec5-3c75003a3556]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:32 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:32 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:32 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:00:32 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Acquiring lock "cinder-bc0fbebd-145f-4701-a93f-6daf8ae8394b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "cinder-bc0fbebd-145f-4701-a93f-6daf8ae8394b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Acquiring lock "cinder-quobyte-bc0fbebd-145f-4701-a93f-6daf8ae8394b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "cinder-quobyte-bc0fbebd-145f-4701-a93f-6daf8ae8394b" acquired by "delete_volume" :: waited 0.058s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97aca0-1fcd-4129-af21-71c79aa55777]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:33 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b Jun 23 14:00:33 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:34 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.660s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:00:34 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 2.231s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:34 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b" returned: 0 in 1.212s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:34 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 1G Jun 23 14:00:34 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:34 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b Jun 23 14:00:34 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:35 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bc0fbebd-145f-4701-a93f-6daf8ae8394b" returned: 0 in 0.886s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "cinder-quobyte-bc0fbebd-145f-4701-a93f-6daf8ae8394b" released by "delete_volume" :: held 2.264s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Created reservations ['d1e54eec-e646-4e8e-9e1d-4212bf1deede', '3d2f160c-6105-4668-82e8-9b8858042d72', '608cd188-015c-434b-b62c-2f0304a09e43', 'ef26afe4-5489-4fb8-82cb-4dbd2453cbbe'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:35 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:00:35 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:36 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 1G" returned: 0 in 1.747s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:36 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 Jun 23 14:00:36 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:36 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.096s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:36 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Deleted volume successfully. Jun 23 14:00:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2c953685-0628-439e-94d1-b51f8dbc11f1 tempest-AttachVolumeShelveTestJSON-1978033259 None] Lock "cinder-bc0fbebd-145f-4701-a93f-6daf8ae8394b-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:37 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7" returned: 0 in 1.445s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:37 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 is being set with open permissions: ugo+rw Jun 23 14:00:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:37 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 Jun 23 14:00:37 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:38 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7" returned: 0 in 1.076s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.764s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c8b0c8ea-aae3-4d4e-b3ee-fda196196747 tempest-VolumesSnapshotListTestJSON-1191940494 None] Create snapshot completed successfully Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-3f57d8ca-125a-4ed9-8290-39ca9101d2c7-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-3f57d8ca-125a-4ed9-8290-39ca9101d2c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-3f57d8ca-125a-4ed9-8290-39ca9101d2c7" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-3f57d8ca-125a-4ed9-8290-39ca9101d2c7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Deleting offline snapshot 3f57d8ca-125a-4ed9-8290-39ca9101d2c7 of volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] snapshot_file for this snap is: volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a5b00-c959-4d58-9982-b3dfb2a3789e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:41 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 Jun 23 14:00:41 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:42 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7" returned: 0 in 1.316s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11998de-37e7-4e20-ae0f-c236282c52d1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:42 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:42 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:43 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 1.130s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:43 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 Jun 23 14:00:43 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:44 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7" returned: 0 in 1.308s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:44 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7 Jun 23 14:00:44 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:45 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.3f57d8ca-125a-4ed9-8290-39ca9101d2c7" returned: 0 in 0.816s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-3f57d8ca-125a-4ed9-8290-39ca9101d2c7" released by "_delete_snapshot" :: held 4.712s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" released by "delete_snapshot" :: held 4.753s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Created reservations ['c4c11280-d167-42ba-aeb7-e23ca5be9e09', '8faa69d5-bce4-4bf4-b189-cebb3c745d14', 'c5977122-ac94-49e1-9910-d0bbf52b656d', 'e901a44a-83e8-456e-93e2-0dcdad543849'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Delete snapshot completed successfully. Jun 23 14:00:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1a8e4e96-9b85-42d7-9c9e-5b1878dae992 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-3f57d8ca-125a-4ed9-8290-39ca9101d2c7-delete_snapshot" released by "delete_snapshot" :: held 5.135s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-15ea18b6-5e0c-48a9-a18a-7b45485ef4bc-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-15ea18b6-5e0c-48a9-a18a-7b45485ef4bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Deleting offline snapshot 15ea18b6-5e0c-48a9-a18a-7b45485ef4bc of volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] snapshot_file for this snap is: volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff0170-772c-4364-9b85-4d9069fc6cd5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:46 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:46 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:47 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 1.120s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55443bb-de69-48e8-b40c-d7008c0f19ba]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:47 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:47 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:48 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 0.931s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:48 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:48 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:49 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 0.948s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:49 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc Jun 23 14:00:49 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:50 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" returned: 0 in 0.756s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-15ea18b6-5e0c-48a9-a18a-7b45485ef4bc" released by "_delete_snapshot" :: held 3.885s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" released by "delete_snapshot" :: held 3.919s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Created reservations ['9489ebc7-93b0-4d97-9a24-50ee870781b4', 'c151484c-eed3-43c7-b6db-ad7982b6d68a', 'f3e0d92c-2792-4d24-b3be-962e27e4d82e', '9a2eba3a-a163-481e-a54a-ca8b0c67d2d8'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Delete snapshot completed successfully. Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7cdcff4f-b464-4164-a457-4b8659dfff5e tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-15ea18b6-5e0c-48a9-a18a-7b45485ef4bc-delete_snapshot" released by "delete_snapshot" :: held 4.097s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-549b0f94-d83d-453f-b5fd-53fea8b62f05-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-549b0f94-d83d-453f-b5fd-53fea8b62f05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-549b0f94-d83d-453f-b5fd-53fea8b62f05" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-549b0f94-d83d-453f-b5fd-53fea8b62f05" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Deleting offline snapshot 549b0f94-d83d-453f-b5fd-53fea8b62f05 of volume 961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] snapshot_file for this snap is: volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc267400-e48d-404b-8223-be2e4a7e8a2e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:50 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:50 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:51 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 0.873s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961c110f-1ede-4094-adbc-32f3c0031eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e6335-40b3-4987-aaaf-4d8fb35d9590]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:51 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 Jun 23 14:00:51 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Flow 'volume_create_manager' (b80044ed-5b92-4049-8c66-37aca3bf15bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66edbf2-0976-4c72-b21e-23becb47e425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66edbf2-0976-4c72-b21e-23becb47e425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1790595923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7f8769-8960-4020-b9f2-c83fe8d792ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63565c8b8744e18c9aa8b51c641c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:52Z,use_quota=True,user_id='1f3b87f62bf5418e8c88f5395169c38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6639224b-9a7c-4413-a506-3911c80e1e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6639224b-9a7c-4413-a506-3911c80e1e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573f504e-436c-4aaf-b4a8-328f737430cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573f504e-436c-4aaf-b4a8-328f737430cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7f8769-8960-4020-b9f2-c83fe8d792ff', 'volume_name': 'volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961af534-f55d-49e0-b73a-39d6ea8952f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961af534-f55d-49e0-b73a-39d6ea8952f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae85539-9e33-4974-9e33-95bd84386fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Volume 6d7f8769-8960-4020-b9f2-c83fe8d792ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff', 'volume_size': 1} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1790595923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7f8769-8960-4020-b9f2-c83fe8d792ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63565c8b8744e18c9aa8b51c641c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:52Z,use_quota=True,user_id='1f3b87f62bf5418e8c88f5395169c38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Creating volume 6d7f8769-8960-4020-b9f2-c83fe8d792ff {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:52 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:52 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff 1073741824 Jun 23 14:00:52 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:52 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4" returned: 0 in 1.149s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:52 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:52 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:53 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff 1073741824" returned: 0 in 1.190s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:53 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff Jun 23 14:00:53 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:54 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff" returned: 0 in 0.875s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae85539-9e33-4974-9e33-95bd84386fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a764e3-9a3c-4ab2-a003-06919a9b3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:54 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Volume volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff (6d7f8769-8960-4020-b9f2-c83fe8d792ff): created successfully Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a764e3-9a3c-4ab2-a003-06919a9b3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Flow 'volume_create_manager' (b80044ed-5b92-4049-8c66-37aca3bf15bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1312aea4-2eab-45d0-a481-a95e8ffb9fd4 tempest-VolumesTransfersTest-351802974 None] Created volume successfully. Jun 23 14:00:54 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 1.561s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:54 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05 Jun 23 14:00:54 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:55 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4.549b0f94-d83d-453f-b5fd-53fea8b62f05" returned: 0 in 1.071s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-549b0f94-d83d-453f-b5fd-53fea8b62f05" released by "_delete_snapshot" :: held 4.899s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" released by "delete_snapshot" :: held 4.952s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:55 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Created reservations ['e4b9efa5-56aa-4f2e-af96-6972425e4a4c', 'a3f04d62-0f0e-404f-87e8-6daaef5439b0', 'a9047117-a8cf-48c7-98bb-c45319dfb387', 'b9a5ce2b-cd58-4edb-b592-37569faf591e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Delete snapshot completed successfully. Jun 23 14:00:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b154992-bc7f-4388-a962-93fbac70a0c9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-549b0f94-d83d-453f-b5fd-53fea8b62f05-delete_snapshot" released by "delete_snapshot" :: held 5.201s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-961c110f-1ede-4094-adbc-32f3c0031eb4-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-961c110f-1ede-4094-adbc-32f3c0031eb4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-01bbb904-25eb-4576-b8d0-333d6717e9f1 tempest-VolumesTransfersTest-1833634845 None] Transfer volume completed successfully. Jun 23 14:00:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39af524-97a6-41e2-9d5e-478bb20d0863]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:56 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 Jun 23 14:00:56 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:57 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4" returned: 0 in 0.826s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:57 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4 Jun 23 14:00:57 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Acquiring lock "cinder-6d7f8769-8960-4020-b9f2-c83fe8d792ff-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-6d7f8769-8960-4020-b9f2-c83fe8d792ff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Acquiring lock "cinder-quobyte-6d7f8769-8960-4020-b9f2-c83fe8d792ff" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-quobyte-6d7f8769-8960-4020-b9f2-c83fe8d792ff" acquired by "delete_volume" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84416ef-463d-49e3-8c45-5922b44fa7df]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:57 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff Jun 23 14:00:57 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:58 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-961c110f-1ede-4094-adbc-32f3c0031eb4" returned: 0 in 0.921s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-quobyte-961c110f-1ede-4094-adbc-32f3c0031eb4" released by "delete_volume" :: held 1.864s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Created reservations ['72340276-e09e-4482-a87c-6dfd62db3183', 'cb00cea9-d06b-408d-9763-c75c5ff08617', 'dd2543ce-95b3-48bf-9295-c6892e4e42bd', '17955d88-b9e5-4869-b991-7c57acbc1016'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:58 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:00:58 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:58 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff" returned: 0 in 1.148s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:58 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff Jun 23 14:00:58 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:58 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Flow 'volume_create_manager' (6e66931d-b09f-456f-95ec-458e36e2989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4dc290-d4be-4541-a508-782a42c2d6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4dc290-d4be-4541-a508-782a42c2d6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-786371670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b31590d-1593-4dbc-a87c-051365305110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079b9a0a82fe40279ef353c621ae1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:59Z,use_quota=True,user_id='bc3ffbc72d5f4c69a56ece3d15ecc087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a026c2f-a74e-4c94-949b-d126b1c4d2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a026c2f-a74e-4c94-949b-d126b1c4d2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cce9f9f-e2cf-4f76-b494-bfa6b0c3efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cce9f9f-e2cf-4f76-b494-bfa6b0c3efa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b31590d-1593-4dbc-a87c-051365305110', 'volume_name': 'volume-5b31590d-1593-4dbc-a87c-051365305110', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ce59fb-c9ba-4124-84ed-43883b88b57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ce59fb-c9ba-4124-84ed-43883b88b57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8c527-32af-41b6-9896-3c349aab1d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:59 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Volume 5b31590d-1593-4dbc-a87c-051365305110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b31590d-1593-4dbc-a87c-051365305110', 'volume_size': 1} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-786371670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b31590d-1593-4dbc-a87c-051365305110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079b9a0a82fe40279ef353c621ae1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:59Z,use_quota=True,user_id='bc3ffbc72d5f4c69a56ece3d15ecc087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Creating volume 5b31590d-1593-4dbc-a87c-051365305110 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:59 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:59 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 1073741824 Jun 23 14:00:59 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:59 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.199s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:59 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Deleted volume successfully. Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cf03eaaa-71d1-4fd4-964d-05bb344feef9 tempest-VolumesSnapshotListTestJSON-1191940494 None] Lock "cinder-961c110f-1ede-4094-adbc-32f3c0031eb4-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d7f8769-8960-4020-b9f2-c83fe8d792ff" returned: 0 in 1.125s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:59 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-quobyte-6d7f8769-8960-4020-b9f2-c83fe8d792ff" released by "delete_volume" :: held 2.340s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:59 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Created reservations ['519805d0-e859-4e95-8e11-6a2ddd45b8cf', '27b73edd-2404-4c40-954c-db1ed419cf2d', '7e973f20-78e7-4d9a-b4cf-3635e391d408', '982e364a-bf95-4395-9629-938d50354c8d'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:00 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:00 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:00 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 1073741824" returned: 0 in 1.345s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:00 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 Jun 23 14:01:00 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:00 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.942s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:00 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:00 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Deleted volume successfully. Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0f55cd47-d276-40ee-a953-16bbdd75ded2 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-6d7f8769-8960-4020-b9f2-c83fe8d792ff-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:01 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Flow 'volume_create_manager' (84a9fdd3-9d68-4daa-be82-dbe6a11e442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76bc2bd-cc62-4869-8198-857c9b82bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110" returned: 0 in 1.176s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] <== create_volume: return (2597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76bc2bd-cc62-4869-8198-857c9b82bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1882879224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01572ca0-8218-4002-8f5c-7ccbbb833afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63565c8b8744e18c9aa8b51c641c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:02Z,use_quota=True,user_id='1f3b87f62bf5418e8c88f5395169c38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c638f3c9-7b27-4ace-9761-48c40c03d0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c638f3c9-7b27-4ace-9761-48c40c03d0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b35682e-3b07-414e-8519-fdfbef66be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b35682e-3b07-414e-8519-fdfbef66be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01572ca0-8218-4002-8f5c-7ccbbb833afd', 'volume_name': 'volume-01572ca0-8218-4002-8f5c-7ccbbb833afd', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2dadbc-56e3-4469-9475-dfa9ea76092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2dadbc-56e3-4469-9475-dfa9ea76092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4775b005-4a81-4d6f-ab18-28018809d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:01 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Volume 01572ca0-8218-4002-8f5c-7ccbbb833afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01572ca0-8218-4002-8f5c-7ccbbb833afd', 'volume_size': 1} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1882879224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01572ca0-8218-4002-8f5c-7ccbbb833afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63565c8b8744e18c9aa8b51c641c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:02Z,use_quota=True,user_id='1f3b87f62bf5418e8c88f5395169c38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Creating volume 01572ca0-8218-4002-8f5c-7ccbbb833afd {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:01 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8c527-32af-41b6-9896-3c349aab1d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b31590d-1593-4dbc-a87c-051365305110', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ede2223-d45c-48c0-8d9d-a33cadaeeaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:01 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd 1073741824 Jun 23 14:01:01 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:01 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Volume volume-5b31590d-1593-4dbc-a87c-051365305110 (5b31590d-1593-4dbc-a87c-051365305110): created successfully Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ede2223-d45c-48c0-8d9d-a33cadaeeaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Flow 'volume_create_manager' (6e66931d-b09f-456f-95ec-458e36e2989d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:01 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f6c87c21-845c-4064-804f-f4a3c195d11a tempest-AttachVolumeTestJSON-2132768425 None] Created volume successfully. Jun 23 14:01:03 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd 1073741824" returned: 0 in 1.246s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:03 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd Jun 23 14:01:03 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:04 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd" returned: 0 in 1.046s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4775b005-4a81-4d6f-ab18-28018809d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01572ca0-8218-4002-8f5c-7ccbbb833afd', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d452b244-6ea2-43bb-a456-34cece39f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Volume volume-01572ca0-8218-4002-8f5c-7ccbbb833afd (01572ca0-8218-4002-8f5c-7ccbbb833afd): created successfully Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d452b244-6ea2-43bb-a456-34cece39f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Flow 'volume_create_manager' (84a9fdd3-9d68-4daa-be82-dbe6a11e442b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3c4ddcc7-f574-4394-b394-6f7750289158 tempest-VolumesTransfersTest-351802974 None] Created volume successfully. Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Acquiring lock "cinder-01572ca0-8218-4002-8f5c-7ccbbb833afd-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-01572ca0-8218-4002-8f5c-7ccbbb833afd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Acquiring lock "cinder-quobyte-01572ca0-8218-4002-8f5c-7ccbbb833afd" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-quobyte-01572ca0-8218-4002-8f5c-7ccbbb833afd" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6313b042-8e40-46c8-b1ed-a1324cefeb4c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:05 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd Jun 23 14:01:05 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[def39744-4268-4c57-a2a9-a7493e6128a4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:05 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 Jun 23 14:01:05 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:06 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd" returned: 0 in 0.944s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:06 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd Jun 23 14:01:06 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:06 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110" returned: 0 in 0.916s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-5b31590d-1593-4dbc-a87c-051365305110', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'decb4004-058b-463c-af90-974bd9b69242', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:01:06 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-7c52cd1e-5056-4f8e-976a-4515801d0efc req-7aec1518-fd4a-48f6-93f2-5a8c11572153 tempest-AttachVolumeTestJSON-2132768425 None] attachment_update completed successfully. Jun 23 14:01:07 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-01572ca0-8218-4002-8f5c-7ccbbb833afd" returned: 0 in 0.846s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-quobyte-01572ca0-8218-4002-8f5c-7ccbbb833afd" released by "delete_volume" :: held 1.853s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Created reservations ['75cc9f88-c926-450e-a13f-98fc658486e6', 'e96ca0dd-a5d0-43a8-8585-d0c769490be0', 'e57664b5-2833-460d-9985-7a5140d695c2', '55b0bfc3-1a29-4dc6-9884-39fbc9c4c024'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:07 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:07 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:08 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.860s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:08 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:08 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Deleted volume successfully. Jun 23 14:01:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-79427053-7186-4b3a-b598-54af89384291 tempest-VolumesTransfersTest-1186239289 None] Lock "cinder-01572ca0-8218-4002-8f5c-7ccbbb833afd-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Flow 'volume_create_manager' (7f3a9fcd-be85-4be1-8b15-3e9195333def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f53507-aafd-42c3-9e5a-d81222f8a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f53507-aafd-42c3-9e5a-d81222f8a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1806282655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af477576-af4b-4d05-8eef-dd587edc6a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079b9a0a82fe40279ef353c621ae1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:13Z,use_quota=True,user_id='bc3ffbc72d5f4c69a56ece3d15ecc087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdf9977-e406-4880-b7f9-f51272dff5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdf9977-e406-4880-b7f9-f51272dff5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834f0c0a-5f23-42fb-a3fd-cb084899393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834f0c0a-5f23-42fb-a3fd-cb084899393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af477576-af4b-4d05-8eef-dd587edc6a21', 'volume_name': 'volume-af477576-af4b-4d05-8eef-dd587edc6a21', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b3d8bf-6af3-40e7-ab6b-57e3a51ee0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b3d8bf-6af3-40e7-ab6b-57e3a51ee0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d21293b-0262-4914-a1e7-f60315a85b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Volume af477576-af4b-4d05-8eef-dd587edc6a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af477576-af4b-4d05-8eef-dd587edc6a21', 'volume_size': 1} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1806282655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af477576-af4b-4d05-8eef-dd587edc6a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079b9a0a82fe40279ef353c621ae1cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:13Z,use_quota=True,user_id='bc3ffbc72d5f4c69a56ece3d15ecc087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Creating volume af477576-af4b-4d05-8eef-dd587edc6a21 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:13 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:01:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:13 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 1073741824 Jun 23 14:01:13 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 1073741824" returned: 0 in 1.066s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:14 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:14 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 Jun 23 14:01:14 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:15 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21" returned: 0 in 1.001s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d21293b-0262-4914-a1e7-f60315a85b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af477576-af4b-4d05-8eef-dd587edc6a21', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0ef9ff-c497-4298-b640-60365e1ee4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:15 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Volume volume-af477576-af4b-4d05-8eef-dd587edc6a21 (af477576-af4b-4d05-8eef-dd587edc6a21): created successfully Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0ef9ff-c497-4298-b640-60365e1ee4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Flow 'volume_create_manager' (7f3a9fcd-be85-4be1-8b15-3e9195333def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-47b5ab69-5782-45af-93e9-ecd479892ba4 tempest-AttachVolumeTestJSON-2132768425 None] Created volume successfully. Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61ed215-0578-4e34-94e5-f39f5f850360]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:19 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 Jun 23 14:01:19 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Flow 'volume_create_manager' (123e747e-263c-405a-b7ac-23a792e6e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85febf9-e155-466b-aae0-cbf7733f5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85febf9-e155-466b-aae0-cbf7733f5311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1099842429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03807bce-c4ee-48d8-aa9e-ee8b3de5879b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d7b990c1964851ade967b95ab65d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:19Z,use_quota=True,user_id='948141e8eba14f58842e7592b1986740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb380ba-ae31-4749-a90b-31dc8323bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb380ba-ae31-4749-a90b-31dc8323bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5346d5-3c4d-4ec7-b406-0037b111be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5346d5-3c4d-4ec7-b406-0037b111be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'volume_name': 'volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4f6010-cbe7-4cc2-8964-368d42dd50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4f6010-cbe7-4cc2-8964-368d42dd50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51490093-d0b0-4022-b6c8-8842d03423d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Volume 03807bce-c4ee-48d8-aa9e-ee8b3de5879b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'volume_size': 1} Jun 23 14:01:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:20 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21" returned: 0 in 0.989s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1099842429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03807bce-c4ee-48d8-aa9e-ee8b3de5879b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d7b990c1964851ade967b95ab65d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:19Z,use_quota=True,user_id='948141e8eba14f58842e7592b1986740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Creating volume 03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:20 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:20 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b 1073741824 Jun 23 14:01:20 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-af477576-af4b-4d05-8eef-dd587edc6a21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8374bd1a-9c5c-4e99-b8ec-a85be37c84f2', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:01:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-c5bf0e7d-e875-44b0-8cd8-22e77cd91c6a req-88617f03-a2f5-4ab1-9890-9f4d8b5ffd75 tempest-AttachVolumeTestJSON-2132768425 None] attachment_update completed successfully. Jun 23 14:01:21 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b 1073741824" returned: 0 in 1.237s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:21 devstack sudo[110174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:21 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:23 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 1.452s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] <== create_volume: return (2804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.807s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51490093-d0b0-4022-b6c8-8842d03423d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68149037-a391-4a72-be3f-2fe3feada17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Volume volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b (03807bce-c4ee-48d8-aa9e-ee8b3de5879b): created successfully Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68149037-a391-4a72-be3f-2fe3feada17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Flow 'volume_create_manager' (123e747e-263c-405a-b7ac-23a792e6e133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-afffd93e-6f5f-4568-b16f-fab90723bab2 tempest-VolumesCloneTest-303489098 None] Created volume successfully. Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Flow 'volume_create_manager' (47765c9f-e093-4111-9a88-57204ab271bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbebbeb-39ea-4b39-96e4-428930be1a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbebbeb-39ea-4b39-96e4-428930be1a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-397099428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02469c79-1764-49ae-a6d9-d3a8ba138d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d7b990c1964851ade967b95ab65d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=03807bce-c4ee-48d8-aa9e-ee8b3de5879b,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:25Z,use_quota=True,user_id='948141e8eba14f58842e7592b1986740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ac5288-7816-490f-b784-d6bc31a8fd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ac5288-7816-490f-b784-d6bc31a8fd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88f0f16-bd58-4cb0-ac12-c940b1902109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88f0f16-bd58-4cb0-ac12-c940b1902109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '02469c79-1764-49ae-a6d9-d3a8ba138d21', 'volume_name': 'volume-02469c79-1764-49ae-a6d9-d3a8ba138d21', 'volume_size': 2, 'source_volid': '03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'source_volstatus': 'available'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0251968b-948f-46eb-ae63-0eafec37ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0251968b-948f-46eb-ae63-0eafec37ab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4788b08a-297f-4c79-b77e-3abb41c1704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:25 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Volume 02469c79-1764-49ae-a6d9-d3a8ba138d21: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-02469c79-1764-49ae-a6d9-d3a8ba138d21', 'volume_size': 2, 'source_volid': '03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'source_volstatus': 'available'} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:25 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Cloning volume 03807bce-c4ee-48d8-aa9e-ee8b3de5879b to volume 02469c79-1764-49ae-a6d9-d3a8ba138d21 Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Creating offline snapshot 0343d59f-4f81-4f52-ab5f-d36841ef6d66 of volume 03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477e23a-d0e9-4c71-8dd6-62f8e06a0a40]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:25 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:25 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:26 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 1.480s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:26 devstack sudo[110365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 1G Jun 23 14:01:26 devstack sudo[110365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:28 devstack sudo[110365]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 1G" returned: 0 in 1.804s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:28 devstack sudo[110451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 Jun 23 14:01:28 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:28 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-50ac87bc-5bbf-482b-b058-21aed32d8ab8 req-768589f6-03cb-4941-ad69-85c605d817ba tempest-AttachVolumeTestJSON-2132768425 None] Terminate volume connection completed successfully. Jun 23 14:01:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-50ac87bc-5bbf-482b-b058-21aed32d8ab8 req-768589f6-03cb-4941-ad69-85c605d817ba tempest-AttachVolumeTestJSON-2132768425 None] Deleting attachment decb4004-058b-463c-af90-974bd9b69242. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:01:29 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66" returned: 0 in 1.298s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:29 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 is being set with open permissions: ugo+rw Jun 23 14:01:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:29 devstack sudo[110501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 Jun 23 14:01:29 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:31 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66" returned: 0 in 1.416s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:31 devstack sudo[110565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info Jun 23 14:01:31 devstack sudo[110565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:32 devstack sudo[110565]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info" returned: 0 in 1.078s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:32 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info is being set with open permissions: ugo+rw Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:32 devstack sudo[110599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:32 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:32 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info Jun 23 14:01:32 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=61,cinder:INSERT=17,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=67,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=3 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:01:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-697b0acc-65b3-4cdb-972e-cf1c53334915 req-96daacbc-5abd-4084-be27-84939d4b694e tempest-AttachVolumeTestJSON-2132768425 None] Terminate volume connection completed successfully. Jun 23 14:01:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-697b0acc-65b3-4cdb-972e-cf1c53334915 req-96daacbc-5abd-4084-be27-84939d4b694e tempest-AttachVolumeTestJSON-2132768425 None] Deleting attachment 8374bd1a-9c5c-4e99-b8ec-a85be37c84f2. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:01:33 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.345s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:01:33 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.info" returned: 0 in 1.516s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Acquiring lock "cinder-quobyte-02469c79-1764-49ae-a6d9-d3a8ba138d21" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-02469c79-1764-49ae-a6d9-d3a8ba138d21" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] snapshot: 0343d59f-4f81-4f52-ab5f-d36841ef6d66, volume: 02469c79-1764-49ae-a6d9-d3a8ba138d21, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bd6e0a-038a-4c51-9b37-5f67906b5366]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:34 devstack sudo[110661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 Jun 23 14:01:34 devstack sudo[110661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:35 devstack sudo[110661]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66" returned: 0 in 1.026s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:01:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:01:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:01:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb1f15f-da87-489d-9d52-678248177233]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:35 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:35 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:36 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 1.222s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:36 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:01:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:36 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 Jun 23 14:01:36 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:43 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21" returned: 0 in 7.412s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792614b-7ce4-4552-a9c6-99f0f3036734]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:43 devstack sudo[111068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:43 devstack sudo[111068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:44 devstack sudo[111068]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 1.248s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:44 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:01:44 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Converted 1024.00 MB image at 138.13 MB/s Jun 23 14:01:44 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 is being set with open permissions: ugo+rw Jun 23 14:01:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:44 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 Jun 23 14:01:44 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:45 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21" returned: 0 in 0.787s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-02469c79-1764-49ae-a6d9-d3a8ba138d21" released by "_copy_volume_from_snapshot" :: held 11.814s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Acquiring lock "cinder-quobyte-0343d59f-4f81-4f52-ab5f-d36841ef6d66" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-0343d59f-4f81-4f52-ab5f-d36841ef6d66" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Deleting offline snapshot 0343d59f-4f81-4f52-ab5f-d36841ef6d66 of volume 03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] snapshot_file for this snap is: volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9200d1d7-c779-4b66-8e76-3d0a707f9d07]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:45 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 Jun 23 14:01:45 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:46 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66" returned: 0 in 1.020s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:01:46 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[211e44df-c978-4db3-9eb5-901b4f1003f2]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:47 devstack sudo[111180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:47 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "cinder-af477576-af4b-4d05-8eef-dd587edc6a21-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-af477576-af4b-4d05-8eef-dd587edc6a21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "cinder-quobyte-af477576-af4b-4d05-8eef-dd587edc6a21" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-quobyte-af477576-af4b-4d05-8eef-dd587edc6a21" acquired by "delete_volume" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70172f7-9a82-41f2-a6de-962dcaa6e704]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:47 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 Jun 23 14:01:47 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:47 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 0.873s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:47 devstack sudo[111211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 Jun 23 14:01:47 devstack sudo[111211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:48 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21" returned: 0 in 0.842s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:48 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21 Jun 23 14:01:48 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:48 devstack sudo[111211]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66" returned: 0 in 0.817s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:48 devstack sudo[111246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66 Jun 23 14:01:48 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:48 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-af477576-af4b-4d05-8eef-dd587edc6a21" returned: 0 in 0.746s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-quobyte-af477576-af4b-4d05-8eef-dd587edc6a21" released by "delete_volume" :: held 1.649s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Created reservations ['88ef99a0-12bf-4799-8446-f9784460c58d', '700aa252-5e8b-41e1-b5ae-951a81c649d0', 'b05535c5-2ba9-4890-9c69-fe06dfe4f3e9', '4a7af2c0-1fba-4c55-8ef3-826d172df780'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:49 devstack sudo[111269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:49 devstack sudo[111269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "cinder-5b31590d-1593-4dbc-a87c-051365305110-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-5b31590d-1593-4dbc-a87c-051365305110-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:49 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b.0343d59f-4f81-4f52-ab5f-d36841ef6d66" returned: 0 in 1.092s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "cinder-quobyte-5b31590d-1593-4dbc-a87c-051365305110" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-0343d59f-4f81-4f52-ab5f-d36841ef6d66" released by "_delete_snapshot" :: held 3.963s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-quobyte-5b31590d-1593-4dbc-a87c-051365305110" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf9dc72-5ff1-4aa9-9141-5c967bce0859]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.749s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4788b08a-297f-4c79-b77e-3abb41c1704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02469c79-1764-49ae-a6d9-d3a8ba138d21', 'volume_size': 2, 'source_volid': '03807bce-c4ee-48d8-aa9e-ee8b3de5879b', 'source_volstatus': 'available'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaec77a-ac8a-4abc-a675-e55ad258c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:49 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Volume volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 (02469c79-1764-49ae-a6d9-d3a8ba138d21): created successfully Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaec77a-ac8a-4abc-a675-e55ad258c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Flow 'volume_create_manager' (47765c9f-e093-4111-9a88-57204ab271bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:49 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6423660a-58f9-49bf-97d5-7fa7456cc800 tempest-VolumesCloneTest-303489098 None] Created volume successfully. Jun 23 14:01:50 devstack sudo[111293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 Jun 23 14:01:50 devstack sudo[111293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Flow 'volume_create_manager' (3dada866-8b3a-4b46-9c0d-268f0127cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:50 devstack sudo[111269]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4dd5c5a-6b21-4a36-98ff-1fba2e9891c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.206s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Deleted volume successfully. Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4dd5c5a-6b21-4a36-98ff-1fba2e9891c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-327823159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a51f4c-6208-4c34-838e-71ec760241a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee43e735b5b47e1b06dcc3b6bed6883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:50Z,use_quota=True,user_id='ec958eb1cfc54b3ebc61da30c8ade66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafa00e5-184b-4458-9642-79406bf9e6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dafa00e5-184b-4458-9642-79406bf9e6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860f9729-deba-41c0-98df-2b1eca31213f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860f9729-deba-41c0-98df-2b1eca31213f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a51f4c-6208-4c34-838e-71ec760241a4', 'volume_name': 'volume-f4a51f4c-6208-4c34-838e-71ec760241a4', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac3481f-c7b1-486e-9c9e-c3c57803a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac3481f-c7b1-486e-9c9e-c3c57803a75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb66cca3-b7d2-4504-b7c0-e4daac66d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Volume f4a51f4c-6208-4c34-838e-71ec760241a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a51f4c-6208-4c34-838e-71ec760241a4', 'volume_size': 1} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-327823159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a51f4c-6208-4c34-838e-71ec760241a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee43e735b5b47e1b06dcc3b6bed6883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:50Z,use_quota=True,user_id='ec958eb1cfc54b3ebc61da30c8ade66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Creating volume f4a51f4c-6208-4c34-838e-71ec760241a4 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:50 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-aa3260cd-1137-4ab5-b7af-c56b2c02569d tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-af477576-af4b-4d05-8eef-dd587edc6a21-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:50 devstack sudo[111316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 1073741824 Jun 23 14:01:50 devstack sudo[111316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Acquiring lock "cinder-02469c79-1764-49ae-a6d9-d3a8ba138d21-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Lock "cinder-02469c79-1764-49ae-a6d9-d3a8ba138d21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Acquiring lock "cinder-quobyte-02469c79-1764-49ae-a6d9-d3a8ba138d21" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-02469c79-1764-49ae-a6d9-d3a8ba138d21" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:51 devstack sudo[111293]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c7d81-4474-4aea-a5a9-9a1b608b79f8]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110" returned: 0 in 1.574s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:51 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110 Jun 23 14:01:51 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:51 devstack sudo[111348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 Jun 23 14:01:51 devstack sudo[111348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:52 devstack sudo[111316]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 1073741824" returned: 0 in 1.574s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:52 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 Jun 23 14:01:52 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:52 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b31590d-1593-4dbc-a87c-051365305110" returned: 0 in 1.094s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-quobyte-5b31590d-1593-4dbc-a87c-051365305110" released by "delete_volume" :: held 2.750s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:52 devstack sudo[111348]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21" returned: 0 in 1.183s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:52 devstack sudo[111429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21 Jun 23 14:01:52 devstack sudo[111429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Created reservations ['b49d8329-d157-4314-b7aa-dee87bbc6ce2', '1d2169e3-e00d-42d2-b7ce-0e0adcbd70c2', '928f6777-8cfa-46cb-aea0-9aa8ff95dd58', '1e945f08-81d5-43d7-8b3a-ed468db2d2c7'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:52 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:52 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "cinder-81329655-1bac-4434-88f3-3feb792ecb1e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-81329655-1bac-4434-88f3-3feb792ecb1e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "cinder-quobyte-81329655-1bac-4434-88f3-3feb792ecb1e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:53 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4" returned: 0 in 1.000s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] <== create_volume: return (2660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.662s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-quobyte-81329655-1bac-4434-88f3-3feb792ecb1e" acquired by "delete_volume" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb66cca3-b7d2-4504-b7c0-e4daac66d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a51f4c-6208-4c34-838e-71ec760241a4', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f868a3d0-6ad8-49b9-bf62-6a4880804966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e1fcb1-fe41-4579-8c0c-4bec7451496a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:53 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Volume volume-f4a51f4c-6208-4c34-838e-71ec760241a4 (f4a51f4c-6208-4c34-838e-71ec760241a4): created successfully Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f868a3d0-6ad8-49b9-bf62-6a4880804966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Flow 'volume_create_manager' (3dada866-8b3a-4b46-9c0d-268f0127cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8534861a-30cd-4613-9054-082b5190f4ed tempest-AttachVolumeNegativeTest-1216548935 None] Created volume successfully. Jun 23 14:01:53 devstack sudo[111459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e Jun 23 14:01:53 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:53 devstack sudo[111429]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-02469c79-1764-49ae-a6d9-d3a8ba138d21" returned: 0 in 0.976s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-02469c79-1764-49ae-a6d9-d3a8ba138d21" released by "delete_volume" :: held 2.217s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:53 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.945s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Deleted volume successfully. Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Created reservations ['64f10f1a-eec2-4fc6-bc98-26cef0ca3f25', 'be8274ff-a422-4b2a-a464-423ce6a1d3ca', '30a5a2fc-e229-4813-8671-185e514e55f1', '247dd900-62bf-4f74-b979-49f884117b45'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-af623b6f-8f2e-447e-8df6-ed93f89c1125 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-5b31590d-1593-4dbc-a87c-051365305110-delete_volume" released by "delete_volume" :: held 4.237s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:53 devstack sudo[111485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:53 devstack sudo[111485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:54 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e" returned: 0 in 1.035s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:54 devstack sudo[111503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e Jun 23 14:01:54 devstack sudo[111503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:54 devstack sudo[111485]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.781s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Deleted volume successfully. Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e3b6893-7a42-45b2-b676-c19b9b14294e tempest-VolumesCloneTest-303489098 None] Lock "cinder-02469c79-1764-49ae-a6d9-d3a8ba138d21-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Acquiring lock "cinder-03807bce-c4ee-48d8-aa9e-ee8b3de5879b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Lock "cinder-03807bce-c4ee-48d8-aa9e-ee8b3de5879b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Acquiring lock "cinder-quobyte-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aca4e03-7c14-4eb6-adb2-f21ad788e470]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:55 devstack sudo[111503]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-81329655-1bac-4434-88f3-3feb792ecb1e" returned: 0 in 0.746s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-quobyte-81329655-1bac-4434-88f3-3feb792ecb1e" released by "delete_volume" :: held 1.833s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:55 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:55 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Created reservations ['f84a6bd7-10c6-4607-9279-ce7898d5027d', 'b5a89243-5777-4081-a4b0-9bb1f39c6ddb', '06293f42-0d7d-4f31-8dfc-1850122fab28', 'b47fcca7-ceb3-470d-adf4-7be4fed5e03a'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:55 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:55 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:55 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 1.050s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:56 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.802s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:56 devstack sudo[111572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b Jun 23 14:01:56 devstack sudo[111572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Deleted volume successfully. Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6137ed31-e7ef-4038-9b54-8c318ecf0057 tempest-AttachVolumeTestJSON-2132768425 None] Lock "cinder-81329655-1bac-4434-88f3-3feb792ecb1e-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0e9b8c-bb5c-422d-86ce-c28c3eb9ee19]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:56 devstack sudo[111572]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" returned: 0 in 0.817s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Lock "cinder-quobyte-03807bce-c4ee-48d8-aa9e-ee8b3de5879b" released by "delete_volume" :: held 1.939s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:56 devstack sudo[111609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 Jun 23 14:01:56 devstack sudo[111609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Created reservations ['0538f1b0-22e3-4106-9347-3bf648f1a6fd', '8875ebf8-0315-449f-9cbe-60b606c2cfe6', '057c22d5-32a8-4b4e-a35a-0f5f2cc8f667', '89b0cc29-d21f-4786-b3ce-dbbf31f7a531'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:57 devstack sudo[111625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:01:57 devstack sudo[111625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:58 devstack sudo[111609]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4" returned: 0 in 1.314s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.345s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-f4a51f4c-6208-4c34-838e-71ec760241a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94edccb8-17a2-4f3f-9762-cdc9c60b15cb', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:01:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-c49a0f38-c0ce-41ac-97e5-4ae495751bf2 req-f7625d36-beb1-41a6-b6a5-f595b5147100 tempest-AttachVolumeNegativeTest-1216548935 None] attachment_update completed successfully. Jun 23 14:01:58 devstack sudo[111625]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.450s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:58 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Deleted volume successfully. Jun 23 14:01:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-488c5f3d-268f-403b-a97f-3b11df7d1822 tempest-VolumesCloneTest-303489098 None] Lock "cinder-03807bce-c4ee-48d8-aa9e-ee8b3de5879b-delete_volume" released by "delete_volume" :: held 3.724s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Flow 'volume_create_manager' (033fc1d3-539d-4ff1-946c-c0b91440231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc87ffa-4347-40d9-8148-dcc0284b76ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc87ffa-4347-40d9-8148-dcc0284b76ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-711910040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab06f00d-8233-49d3-88a1-eb7051f6d5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869693b580bb41cd8caea91a205bdb11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:02Z,use_quota=True,user_id='429bc4f6412342e0a68ea7a8a07fca11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025c4f1c-fd94-4ab1-818e-e295e8117756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025c4f1c-fd94-4ab1-818e-e295e8117756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb6d524-33e2-4f90-b5d1-503948c3dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb6d524-33e2-4f90-b5d1-503948c3dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab06f00d-8233-49d3-88a1-eb7051f6d5a7', 'volume_name': 'volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bf2277-638f-4e57-aefc-24fdb2f631df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bf2277-638f-4e57-aefc-24fdb2f631df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752baa65-4302-4c7f-880c-d48935d2809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:02 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Volume ab06f00d-8233-49d3-88a1-eb7051f6d5a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7', 'volume_size': 1} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-711910040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab06f00d-8233-49d3-88a1-eb7051f6d5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869693b580bb41cd8caea91a205bdb11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:02Z,use_quota=True,user_id='429bc4f6412342e0a68ea7a8a07fca11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Creating volume ab06f00d-8233-49d3-88a1-eb7051f6d5a7 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:02 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:02:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:02 devstack sudo[112257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 1073741824 Jun 23 14:02:02 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:03 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 1073741824" returned: 0 in 1.252s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:03 devstack sudo[112303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 Jun 23 14:02:03 devstack sudo[112303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:05 devstack sudo[112303]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7" returned: 0 in 1.177s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] <== create_volume: return (2492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752baa65-4302-4c7f-880c-d48935d2809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83cce9d-c0e2-4055-8fad-aee5f0a4c0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Volume volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 (ab06f00d-8233-49d3-88a1-eb7051f6d5a7): created successfully Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83cce9d-c0e2-4055-8fad-aee5f0a4c0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Flow 'volume_create_manager' (033fc1d3-539d-4ff1-946c-c0b91440231d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:05 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6213ab08-f7bf-4805-8c4c-cb862ffb20aa tempest-VolumesNegativeTest-362427457 None] Created volume successfully. Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Flow 'volume_create_manager' (e3e90dc1-e5c7-433b-8444-ebb2a5219020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a27d126-907c-4e31-94c4-029d19d61aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a27d126-907c-4e31-94c4-029d19d61aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-763413291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf7d84a-f15d-4600-a246-62a6c51aaf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe463f0be7ce415698ed76d51c3b66e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:05Z,use_quota=True,user_id='f6b58e37f5c24b0baf9c8259f60f341a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b58e26-9707-451b-a368-b8836e4f35c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b58e26-9707-451b-a368-b8836e4f35c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c124e4e-4ae4-4af6-8405-bd92c073c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c124e4e-4ae4-4af6-8405-bd92c073c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf7d84a-f15d-4600-a246-62a6c51aaf75', 'volume_name': 'volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f361ad61-aef1-4ad3-8d5b-e85451892ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f361ad61-aef1-4ad3-8d5b-e85451892ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0633cd86-b060-4df8-9fc8-27eea8e0e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Volume dbf7d84a-f15d-4600-a246-62a6c51aaf75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75', 'volume_size': 1} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-763413291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf7d84a-f15d-4600-a246-62a6c51aaf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe463f0be7ce415698ed76d51c3b66e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:05Z,use_quota=True,user_id='f6b58e37f5c24b0baf9c8259f60f341a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Creating volume dbf7d84a-f15d-4600-a246-62a6c51aaf75 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:05 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:02:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:05 devstack sudo[112358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 1073741824 Jun 23 14:02:05 devstack sudo[112358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:06 devstack sudo[112358]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 1073741824" returned: 0 in 1.560s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:07 devstack sudo[112415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 Jun 23 14:02:07 devstack sudo[112415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:08 devstack sudo[112415]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75" returned: 0 in 1.038s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] <== create_volume: return (2691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.694s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0633cd86-b060-4df8-9fc8-27eea8e0e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da069d4-5e03-4e1e-9d7a-e65f0a5cd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Volume volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 (dbf7d84a-f15d-4600-a246-62a6c51aaf75): created successfully Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da069d4-5e03-4e1e-9d7a-e65f0a5cd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Flow 'volume_create_manager' (e3e90dc1-e5c7-433b-8444-ebb2a5219020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:08 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9bc69502-ecf7-48ab-a508-6e1563b5065b tempest-TestMinimumBasicScenario-1430604347 None] Created volume successfully. Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Flow 'volume_create_manager' (6696cd22-4255-4924-af09-7dbdb4bdfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03d5e15-fe35-48d8-a1be-73811209252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03d5e15-fe35-48d8-a1be-73811209252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1190162591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3496a7-4405-4223-ab2f-273152c5a88e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a77a06c0d17a441dac84a921921e5dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:09Z,use_quota=True,user_id='a8cf50669b754af186e5603cc910a0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3146b6ad-210d-40c6-b6ca-2b4551ceaf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3146b6ad-210d-40c6-b6ca-2b4551ceaf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5516d9a-12ea-4d1a-8eb3-504dfcedf2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5516d9a-12ea-4d1a-8eb3-504dfcedf2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3496a7-4405-4223-ab2f-273152c5a88e', 'volume_name': 'volume-0e3496a7-4405-4223-ab2f-273152c5a88e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd84bda-2431-465a-9f15-277d907f4d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd84bda-2431-465a-9f15-277d907f4d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5937edc9-f0d2-40ee-8d41-6004308258f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Volume 0e3496a7-4405-4223-ab2f-273152c5a88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3496a7-4405-4223-ab2f-273152c5a88e', 'volume_size': 1} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1190162591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3496a7-4405-4223-ab2f-273152c5a88e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a77a06c0d17a441dac84a921921e5dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:09Z,use_quota=True,user_id='a8cf50669b754af186e5603cc910a0c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Creating volume 0e3496a7-4405-4223-ab2f-273152c5a88e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:09 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:02:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:09 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e 1073741824 Jun 23 14:02:09 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:10 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e 1073741824" returned: 0 in 1.168s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:10 devstack sudo[112530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e Jun 23 14:02:10 devstack sudo[112530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:11 devstack sudo[112530]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e" returned: 0 in 0.813s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5937edc9-f0d2-40ee-8d41-6004308258f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3496a7-4405-4223-ab2f-273152c5a88e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88065b35-97f0-4294-8958-38d55f100520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Volume volume-0e3496a7-4405-4223-ab2f-273152c5a88e (0e3496a7-4405-4223-ab2f-273152c5a88e): created successfully Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88065b35-97f0-4294-8958-38d55f100520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Flow 'volume_create_manager' (6696cd22-4255-4924-af09-7dbdb4bdfcba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-9de71989-3b61-4452-b51c-fa67ac22b692 req-e6329afd-a23c-4d60-8ea6-7c6ab9a54914 tempest-VolumesGetTestJSON-989643855 None] Created volume successfully. Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Acquiring lock "cinder-0e3496a7-4405-4223-ab2f-273152c5a88e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Lock "cinder-0e3496a7-4405-4223-ab2f-273152c5a88e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Acquiring lock "cinder-quobyte-0e3496a7-4405-4223-ab2f-273152c5a88e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Lock "cinder-quobyte-0e3496a7-4405-4223-ab2f-273152c5a88e" acquired by "delete_volume" :: waited 0.038s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[442bf12b-6a41-4ccb-b9e6-758a0601cbce]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:12 devstack sudo[112634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e Jun 23 14:02:12 devstack sudo[112634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:13 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3305318e-61bd-46a3-99a3-305002815a9d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:13 devstack sudo[112646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 Jun 23 14:02:13 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:13 devstack sudo[112634]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e" returned: 0 in 1.050s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:13 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e Jun 23 14:02:13 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:14 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75" returned: 0 in 1.112s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.150s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2f9bea7-d5e5-4947-ac86-309096266708', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:02:14 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-396494ef-04ea-4121-ada2-7b9140e2f21a req-ef462a3d-7ce7-4243-9901-8ae297db0cf4 tempest-TestMinimumBasicScenario-1430604347 None] attachment_update completed successfully. Jun 23 14:02:14 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0e3496a7-4405-4223-ab2f-273152c5a88e" returned: 0 in 0.890s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Lock "cinder-quobyte-0e3496a7-4405-4223-ab2f-273152c5a88e" released by "delete_volume" :: held 2.058s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:14 devstack cinder-volume[93689]: DEBUG cinder.quota [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Created reservations ['f7e81ff3-a4dc-4335-b8b7-2c2ab8b5ebff', '0160877a-8c4a-480d-9933-fc86c23d9a41', '92c3864a-e37c-4eae-b322-8e2e95d03f91', '20c6cae4-aed9-461a-b00d-5da69283c32f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:15 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:02:15 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:16 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.992s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:16 devstack cinder-volume[93689]: DEBUG cinder.manager [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Deleted volume successfully. Jun 23 14:02:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-b5439c49-393c-47a7-b664-53a3cb491631 req-34b9ce7a-e2bf-4301-be71-b63ab401ad42 tempest-VolumesGetTestJSON-989643855 None] Lock "cinder-0e3496a7-4405-4223-ab2f-273152c5a88e-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:25 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=63,cinder:SELECT=45,cinder:INSERT=15,cinder:DELETE=4 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:32 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:02:32 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:34 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.802s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:34 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:34 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:02:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:02:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:02:35 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=56,cinder:INSERT=14,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Flow 'volume_create_manager' (10f258d7-105b-459b-b6d2-172a999b0de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2c87b8-c756-4bad-b9bb-e22f41c125fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2c87b8-c756-4bad-b9bb-e22f41c125fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-843890245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3a5bf1752430294e88601e812eb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:45Z,use_quota=True,user_id='c6a5353741b54d00923c8b03b519d8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b0c069-6bfb-4e36-b930-ed8a148a3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b0c069-6bfb-4e36-b930-ed8a148a3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48c09a9-9904-4c7b-8b45-b8b1fd2e2004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48c09a9-9904-4c7b-8b45-b8b1fd2e2004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82', 'volume_name': 'volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da319803-40a4-4fc7-b99c-2eeba98f9e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da319803-40a4-4fc7-b99c-2eeba98f9e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da6cda6-19e7-4abf-acd8-487f5a8777c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:45 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Volume bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82', 'volume_size': 1} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-843890245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3a5bf1752430294e88601e812eb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:45Z,use_quota=True,user_id='c6a5353741b54d00923c8b03b519d8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Creating volume bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:45 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:02:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:45 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 1073741824 Jun 23 14:02:45 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:46 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 1073741824" returned: 0 in 0.993s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:46 devstack sudo[114038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 Jun 23 14:02:46 devstack sudo[114038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:47 devstack sudo[114038]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82" returned: 0 in 0.738s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da6cda6-19e7-4abf-acd8-487f5a8777c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350232a9-e96b-4275-a7db-ad4dc33b70b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:47 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Volume volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 (bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82): created successfully Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350232a9-e96b-4275-a7db-ad4dc33b70b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Flow 'volume_create_manager' (10f258d7-105b-459b-b6d2-172a999b0de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b035b4af-dbf5-40fa-909d-dbc4a973b072 tempest-VolumeQuotasNegativeTestJSON-941096308 None] Created volume successfully. Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Acquiring lock "cinder-ab06f00d-8233-49d3-88a1-eb7051f6d5a7-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Lock "cinder-ab06f00d-8233-49d3-88a1-eb7051f6d5a7-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Acquiring lock "cinder-quobyte-ab06f00d-8233-49d3-88a1-eb7051f6d5a7" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Lock "cinder-quobyte-ab06f00d-8233-49d3-88a1-eb7051f6d5a7" acquired by "delete_volume" :: waited 0.038s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Acquiring lock "cinder-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "cinder-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986177a-9bb3-44f3-94f6-8666513bbc33]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Acquiring lock "cinder-quobyte-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "cinder-quobyte-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82" acquired by "delete_volume" :: waited 0.038s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:49 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7ecc63-7684-4996-b0ec-27b9de38fd84]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:49 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 Jun 23 14:02:49 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:49 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 Jun 23 14:02:49 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:50 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82" returned: 0 in 1.335s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:50 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82 Jun 23 14:02:50 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:50 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7" returned: 0 in 1.660s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:50 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7 Jun 23 14:02:50 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:51 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82" returned: 0 in 1.457s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "cinder-quobyte-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82" released by "delete_volume" :: held 2.889s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Created reservations ['e1467039-9e9e-4552-93f5-17460ad1a26f', '95f2626c-e146-48c5-a234-3a00481eb5d9', '3b807ad0-314d-4518-8d59-fb2f1b6fe8e1', 'd21b3733-d6e4-4993-a3f1-121728ffc5d4'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:52 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:02:52 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:52 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ab06f00d-8233-49d3-88a1-eb7051f6d5a7" returned: 0 in 2.069s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Lock "cinder-quobyte-ab06f00d-8233-49d3-88a1-eb7051f6d5a7" released by "delete_volume" :: held 3.840s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Created reservations ['3945cd2f-7964-4ff0-8c78-200b9a7e9f65', 'e6005009-f2b9-40ca-ba81-53c18ebff194', 'dadeeab8-b1b0-4471-afea-9934eb1efecf', '3dd00e5d-e45a-4ef1-a2ed-c396a036e3b3'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:52 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:02:52 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:53 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.124s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:53 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Deleted volume successfully. Jun 23 14:02:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd313f4f-15ab-4417-8f3f-d6a1aa4f7def tempest-VolumeQuotasNegativeTestJSON-941096308 None] Lock "cinder-bf99c4a4-5ecc-4bf3-9e67-57a5c8e6ab82-delete_volume" released by "delete_volume" :: held 4.741s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:54 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.501s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:54 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Deleted volume successfully. Jun 23 14:02:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6c3d5fd8-46c7-4e6b-98e4-d6fef005bc4d tempest-VolumesNegativeTest-362427457 None] Lock "cinder-ab06f00d-8233-49d3-88a1-eb7051f6d5a7-delete_volume" released by "delete_volume" :: held 5.806s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Flow 'volume_create_manager' (a419ee03-17b6-435f-831f-da83737dc8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6094717-23d0-43e2-9a9b-5732932a0616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6094717-23d0-43e2-9a9b-5732932a0616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-441070564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835f795b-1c44-44d6-b6d7-9851129708a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831136cf45254511b152e7e972a2b4ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:02Z,use_quota=True,user_id='ff4e78219a664219b7e6ffb2e520340a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65d16e4a-894d-44a3-889b-61a901e1e262),volume_type_id=65d16e4a-894d-44a3-889b-61a901e1e262)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4937ffad-e397-4934-97d7-96207784c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4937ffad-e397-4934-97d7-96207784c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a05391-f6e6-4942-bbbe-f8a5f5fe863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a05391-f6e6-4942-bbbe-f8a5f5fe863c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835f795b-1c44-44d6-b6d7-9851129708a5', 'volume_name': 'volume-835f795b-1c44-44d6-b6d7-9851129708a5', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765ae39a-a0c4-425a-afcb-a79c21650f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765ae39a-a0c4-425a-afcb-a79c21650f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c81ba0c-c0fe-4035-b065-76c29978ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Volume 835f795b-1c44-44d6-b6d7-9851129708a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835f795b-1c44-44d6-b6d7-9851129708a5', 'volume_size': 1} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-441070564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835f795b-1c44-44d6-b6d7-9851129708a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831136cf45254511b152e7e972a2b4ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:02Z,use_quota=True,user_id='ff4e78219a664219b7e6ffb2e520340a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65d16e4a-894d-44a3-889b-61a901e1e262),volume_type_id=65d16e4a-894d-44a3-889b-61a901e1e262)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Creating volume 835f795b-1c44-44d6-b6d7-9851129708a5 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:02 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:02 devstack sudo[114693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 1073741824 Jun 23 14:03:02 devstack sudo[114693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:03 devstack sudo[114693]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 1073741824" returned: 0 in 1.363s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:03 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 Jun 23 14:03:03 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:04 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5" returned: 0 in 0.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c81ba0c-c0fe-4035-b065-76c29978ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835f795b-1c44-44d6-b6d7-9851129708a5', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7c3fba-06fe-4af9-ba00-62ce7754a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Volume volume-835f795b-1c44-44d6-b6d7-9851129708a5 (835f795b-1c44-44d6-b6d7-9851129708a5): created successfully Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7c3fba-06fe-4af9-ba00-62ce7754a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Flow 'volume_create_manager' (a419ee03-17b6-435f-831f-da83737dc8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c1cbae10-692d-41c7-ac1f-c084b83b4529 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Created volume successfully. Jun 23 14:03:05 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d18281a6-6257-46d3-8ae2-6d5c5506a618 req-72587348-1f30-4b9c-afbe-7f6b7d592002 tempest-AttachVolumeNegativeTest-1216548935 None] Terminate volume connection completed successfully. Jun 23 14:03:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-d18281a6-6257-46d3-8ae2-6d5c5506a618 req-72587348-1f30-4b9c-afbe-7f6b7d592002 tempest-AttachVolumeNegativeTest-1216548935 None] Deleting attachment 94edccb8-17a2-4f3f-9762-cdc9c60b15cb. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:03:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:06 devstack sudo[114827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:06 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:07 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.189s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:07 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b8f525fd-be91-4f86-8709-cebb8632a573 tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Retype volume completed successfully. Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Acquiring lock "cinder-835f795b-1c44-44d6-b6d7-9851129708a5-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "cinder-835f795b-1c44-44d6-b6d7-9851129708a5-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Acquiring lock "cinder-quobyte-835f795b-1c44-44d6-b6d7-9851129708a5" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "cinder-quobyte-835f795b-1c44-44d6-b6d7-9851129708a5" acquired by "delete_volume" :: waited 0.049s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd279f8e-1db5-409b-9a8a-1a4e4d8a3ffb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:08 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 Jun 23 14:03:08 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5" returned: 0 in 1.262s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:09 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:09 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5 Jun 23 14:03:09 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:10 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-835f795b-1c44-44d6-b6d7-9851129708a5" returned: 0 in 1.203s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "cinder-quobyte-835f795b-1c44-44d6-b6d7-9851129708a5" released by "delete_volume" :: held 2.547s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:10 devstack cinder-volume[93689]: WARNING cinder.quota [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:03:10 devstack cinder-volume[93689]: WARNING cinder.quota [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Created reservations ['baea1a5e-3cc4-4d27-8682-99871c284ce3', 'bd5b03d5-17d7-4b4c-aa42-6daa1b65a6b7', '4cfe1a87-43c8-4da8-aeea-f4a9a5f694bd', '8eb69e26-0433-4724-9418-ec8bb18e701c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:10 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:10 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:11 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.025s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:11 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Deleted volume successfully. Jun 23 14:03:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9334eaf-96f8-48d8-a015-f601e547525b tempest-VolumeRetypeWithoutMigrationTest-1119823853 None] Lock "cinder-835f795b-1c44-44d6-b6d7-9851129708a5-delete_volume" released by "delete_volume" :: held 3.977s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:20 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:DELETE=2,cinder:INSERT=8 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:03:21 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=16,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Flow 'volume_create_manager' (41a63462-8a73-4c09-ab4c-a2479308d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74288914-05f1-4ef5-9369-16ceb3fc626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74288914-05f1-4ef5-9369-16ceb3fc626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-875358557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80278729-f903-4a01-8aa5-42774bcec7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9bfc09b90040cd9bfaaaf9d91f4a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:27Z,use_quota=True,user_id='7ec110ba233142e6bd62587e48456388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeacb1ee-68d6-4c7c-a343-1f338cb86819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeacb1ee-68d6-4c7c-a343-1f338cb86819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dc0b3b-f15c-43a1-bf19-0d3c1da2261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dc0b3b-f15c-43a1-bf19-0d3c1da2261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80278729-f903-4a01-8aa5-42774bcec7a2', 'volume_name': 'volume-80278729-f903-4a01-8aa5-42774bcec7a2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74877d4-c511-45a3-b2d1-e356a7ed8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74877d4-c511-45a3-b2d1-e356a7ed8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58076ad0-7c3a-4acb-b158-79975ac01d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:27 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Volume 80278729-f903-4a01-8aa5-42774bcec7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80278729-f903-4a01-8aa5-42774bcec7a2', 'volume_size': 1} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-875358557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80278729-f903-4a01-8aa5-42774bcec7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9bfc09b90040cd9bfaaaf9d91f4a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:27Z,use_quota=True,user_id='7ec110ba233142e6bd62587e48456388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Creating volume 80278729-f903-4a01-8aa5-42774bcec7a2 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:27 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:27 devstack sudo[115563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 1073741824 Jun 23 14:03:27 devstack sudo[115563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:28 devstack sudo[115563]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 1073741824" returned: 0 in 0.884s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:28 devstack sudo[115596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 Jun 23 14:03:28 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:28 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2" returned: 0 in 0.738s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58076ad0-7c3a-4acb-b158-79975ac01d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80278729-f903-4a01-8aa5-42774bcec7a2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d35b3e-3f30-4452-8a33-0245f5337b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:28 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Volume volume-80278729-f903-4a01-8aa5-42774bcec7a2 (80278729-f903-4a01-8aa5-42774bcec7a2): created successfully Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d35b3e-3f30-4452-8a33-0245f5337b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Flow 'volume_create_manager' (41a63462-8a73-4c09-ab4c-a2479308d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:28 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cdc43af3-86b7-4b1e-ae3c-b1222d3c43d4 tempest-VolumesListAdminTestJSON-764097641 None] Created volume successfully. Jun 23 14:03:29 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Flow 'volume_create_manager' (461af5d3-27be-40ca-8d3b-4d234a52c716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408fa72e-93c2-4556-8104-620c4fb16334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408fa72e-93c2-4556-8104-620c4fb16334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-823661128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315de9a8-36e9-480a-9d6a-cf832dfd17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9bfc09b90040cd9bfaaaf9d91f4a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:30Z,use_quota=True,user_id='7ec110ba233142e6bd62587e48456388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047d7290-9262-44b6-9cd4-dce6c0e69f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047d7290-9262-44b6-9cd4-dce6c0e69f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd60d77f-db78-4e0c-aa85-d18371e9cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd60d77f-db78-4e0c-aa85-d18371e9cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315de9a8-36e9-480a-9d6a-cf832dfd17aa', 'volume_name': 'volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec34f54-18eb-4c53-b9a2-f25aeab7d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec34f54-18eb-4c53-b9a2-f25aeab7d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c9c6b0-adf1-4677-83b0-23ee3c812aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Volume 315de9a8-36e9-480a-9d6a-cf832dfd17aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa', 'volume_size': 1} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-823661128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315de9a8-36e9-480a-9d6a-cf832dfd17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9bfc09b90040cd9bfaaaf9d91f4a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:30Z,use_quota=True,user_id='7ec110ba233142e6bd62587e48456388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Creating volume 315de9a8-36e9-480a-9d6a-cf832dfd17aa {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:30 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:30 devstack sudo[115664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa 1073741824 Jun 23 14:03:30 devstack sudo[115664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Flow 'volume_create_manager' (1c7066af-53dd-40eb-97e9-34c1428f655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c232fafb-8dc5-42ed-b0f2-1180d1c1148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c232fafb-8dc5-42ed-b0f2-1180d1c1148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156103371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624aecc433ce453297b3b0027513e12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:31Z,use_quota=True,user_id='4f6c014006d14d6a94ddfb5dd7608f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7723b9a-b49e-4ccc-8a07-857334c5c357),volume_type_id=f7723b9a-b49e-4ccc-8a07-857334c5c357)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dc9d70-8c81-43f3-af7d-7d39685b91a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dc9d70-8c81-43f3-af7d-7d39685b91a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a93f41-5518-422d-8e81-1f2f6aa445ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a93f41-5518-422d-8e81-1f2f6aa445ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b', 'volume_name': 'volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fabd31-6ad4-4183-a28e-625eaaaa140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fabd31-6ad4-4183-a28e-625eaaaa140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719231a3-e23f-4e21-9b44-92b5dcb11972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Volume 6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b', 'volume_size': 1} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:31 devstack sudo[115664]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa 1073741824" returned: 0 in 1.544s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:31 devstack sudo[115731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa Jun 23 14:03:31 devstack sudo[115731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Flow 'volume_create_manager' (7d6e57d0-0039-4a22-90d7-57d6e71bf070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf3dbc5-5298-4f93-af45-f3bd7408d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:32 devstack sudo[115755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:32 devstack sudo[115755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf3dbc5-5298-4f93-af45-f3bd7408d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1045535332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d1ea12-a6e9-486f-b245-217798c56e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624aecc433ce453297b3b0027513e12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:32Z,use_quota=True,user_id='4f6c014006d14d6a94ddfb5dd7608f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70b92856-9f71-4d39-bc85-05e3031c71c8),volume_type_id=70b92856-9f71-4d39-bc85-05e3031c71c8)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10be001f-803f-47e9-a3a9-773947a8f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10be001f-803f-47e9-a3a9-773947a8f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8630b97b-b162-464e-83b2-a49e7f731532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8630b97b-b162-464e-83b2-a49e7f731532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d1ea12-a6e9-486f-b245-217798c56e01', 'volume_name': 'volume-61d1ea12-a6e9-486f-b245-217798c56e01', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe8f355-9eef-4d08-b762-cb068796bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe8f355-9eef-4d08-b762-cb068796bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5d610b-4579-46f6-8ea9-748d9e225e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Volume 61d1ea12-a6e9-486f-b245-217798c56e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d1ea12-a6e9-486f-b245-217798c56e01', 'volume_size': 1} Jun 23 14:03:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:33 devstack sudo[115731]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa" returned: 0 in 1.603s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] <== create_volume: return (3241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.244s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156103371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624aecc433ce453297b3b0027513e12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:31Z,use_quota=True,user_id='4f6c014006d14d6a94ddfb5dd7608f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7723b9a-b49e-4ccc-8a07-857334c5c357),volume_type_id=f7723b9a-b49e-4ccc-8a07-857334c5c357)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Creating volume 6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:33 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c9c6b0-adf1-4677-83b0-23ee3c812aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:33 devstack sudo[115804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b 1073741824 Jun 23 14:03:33 devstack sudo[115804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcc83ef-0001-4493-b4fe-2f83ca27b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:33 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Volume volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa (315de9a8-36e9-480a-9d6a-cf832dfd17aa): created successfully Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcc83ef-0001-4493-b4fe-2f83ca27b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Flow 'volume_create_manager' (461af5d3-27be-40ca-8d3b-4d234a52c716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c81a0c20-adac-46ea-8367-a64d69953609 tempest-VolumesListAdminTestJSON-764097641 None] Created volume successfully. Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Flow 'volume_create_manager' (afae9c75-59ed-461f-bf67-f8aab6812c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71aa6d99-d542-43e4-8298-e4ec192aee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71aa6d99-d542-43e4-8298-e4ec192aee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1639002548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bc88ff-546e-448b-a86a-1b1d1593077c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624aecc433ce453297b3b0027513e12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:34Z,use_quota=True,user_id='4f6c014006d14d6a94ddfb5dd7608f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25ff2ec4-4eef-4911-a864-58455ef27c6f),volume_type_id=25ff2ec4-4eef-4911-a864-58455ef27c6f)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6a977d-a33f-4971-9156-51b6ca1d9628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6a977d-a33f-4971-9156-51b6ca1d9628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81a861-acd2-4e2c-9f83-3378ef317cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:03:33 devstack sudo[115755]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.515s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 8 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:03:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:03:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb81a861-acd2-4e2c-9f83-3378ef317cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6bc88ff-546e-448b-a86a-1b1d1593077c', 'volume_name': 'volume-d6bc88ff-546e-448b-a86a-1b1d1593077c', 'volume_size': 1, 'image_id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4383d24d-f855-4254-ad24-c8bf0c755cb6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2069833186', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '624aecc433ce453297b3b0027513e12e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'created_at': datetime.datetime(2026, 6, 23, 12, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 3, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4383d24d-f855-4254-ad24-c8bf0c755cb6/file', 'properties': {}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2b0009-951f-431f-a379-75c146cd2c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2b0009-951f-431f-a379-75c146cd2c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afb8302-7201-47a9-9f7c-18676ae2b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Volume d6bc88ff-546e-448b-a86a-1b1d1593077c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6bc88ff-546e-448b-a86a-1b1d1593077c', 'volume_size': 1, 'image_id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4383d24d-f855-4254-ad24-c8bf0c755cb6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2069833186', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '624aecc433ce453297b3b0027513e12e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'created_at': datetime.datetime(2026, 6, 23, 12, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 3, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4383d24d-f855-4254-ad24-c8bf0c755cb6/file', 'properties': {}}, 'image_service': } Jun 23 14:03:34 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Trying to clone d6bc88ff-546e-448b-a86a-1b1d1593077c from image 4383d24d-f855-4254-ad24-c8bf0c755cb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4383d24d-f855-4254-ad24-c8bf0c755cb6', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:03:35 devstack sudo[115804]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b 1073741824" returned: 0 in 1.660s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:35 devstack sudo[115886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b Jun 23 14:03:35 devstack sudo[115886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Flow 'volume_create_manager' (686503bd-a8c1-417f-9991-dcf6dc3a3832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a7e919-68d8-4797-b2db-82029cf95e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a7e919-68d8-4797-b2db-82029cf95e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-924069166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503e50ca-2440-4ccd-87f5-33c836178fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9bfc09b90040cd9bfaaaf9d91f4a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:35Z,use_quota=True,user_id='7ec110ba233142e6bd62587e48456388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb273c9-f602-4a72-8efc-5eeb87a4ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb273c9-f602-4a72-8efc-5eeb87a4ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200e8774-3e50-4a38-9224-8bbb6bdeb0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200e8774-3e50-4a38-9224-8bbb6bdeb0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503e50ca-2440-4ccd-87f5-33c836178fb6', 'volume_name': 'volume-503e50ca-2440-4ccd-87f5-33c836178fb6', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f07531-4b38-4669-a3d8-279d4826da7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f07531-4b38-4669-a3d8-279d4826da7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02013d77-28ad-4369-aadf-bef7f4bb2d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:35 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Volume 503e50ca-2440-4ccd-87f5-33c836178fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503e50ca-2440-4ccd-87f5-33c836178fb6', 'volume_size': 1} Jun 23 14:03:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:36 devstack sudo[115886]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" returned: 0 in 1.168s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] <== create_volume: return (2958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.963s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.857s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1045535332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d1ea12-a6e9-486f-b245-217798c56e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624aecc433ce453297b3b0027513e12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:32Z,use_quota=True,user_id='4f6c014006d14d6a94ddfb5dd7608f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70b92856-9f71-4d39-bc85-05e3031c71c8),volume_type_id=70b92856-9f71-4d39-bc85-05e3031c71c8)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Creating volume 61d1ea12-a6e9-486f-b245-217798c56e01 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:36 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719231a3-e23f-4e21-9b44-92b5dcb11972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack sudo[115965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 1073741824 Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeafd490-07f2-4600-ba32-d589d1f7e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack sudo[115965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Volume volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b (6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b): created successfully Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeafd490-07f2-4600-ba32-d589d1f7e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Flow 'volume_create_manager' (1c7066af-53dd-40eb-97e9-34c1428f655f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-43bed65b-6053-413f-a317-05a79233621d tempest-TestInstancesWithCinderVolumes-611890464 None] Created volume successfully. Jun 23 14:03:37 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d7e68d7d-b171-4645-ad70-ec730d1af405 req-028010b1-8ee3-46b2-8e6a-d145b9914c6e tempest-TestMinimumBasicScenario-1430604347 None] Terminate volume connection completed successfully. Jun 23 14:03:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-d7e68d7d-b171-4645-ad70-ec730d1af405 req-028010b1-8ee3-46b2-8e6a-d145b9914c6e tempest-TestMinimumBasicScenario-1430604347 None] Deleting attachment b2f9bea7-d5e5-4947-ac86-309096266708. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:03:37 devstack sudo[115965]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 1073741824" returned: 0 in 1.168s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:37 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 Jun 23 14:03:37 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:38 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01" returned: 0 in 0.751s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.784s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-924069166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503e50ca-2440-4ccd-87f5-33c836178fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9bfc09b90040cd9bfaaaf9d91f4a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:35Z,use_quota=True,user_id='7ec110ba233142e6bd62587e48456388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Creating volume 503e50ca-2440-4ccd-87f5-33c836178fb6 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:38 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:38 devstack sudo[116050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 1073741824 Jun 23 14:03:38 devstack sudo[116050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5d610b-4579-46f6-8ea9-748d9e225e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d1ea12-a6e9-486f-b245-217798c56e01', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f58d06b-0c29-4b29-ada2-1f60957256f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:38 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Volume volume-61d1ea12-a6e9-486f-b245-217798c56e01 (61d1ea12-a6e9-486f-b245-217798c56e01): created successfully Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f58d06b-0c29-4b29-ada2-1f60957256f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Flow 'volume_create_manager' (7d6e57d0-0039-4a22-90d7-57d6e71bf070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-58a3ff54-a4d5-43bf-aa40-83dcb1dab2b2 tempest-TestInstancesWithCinderVolumes-611890464 None] Created volume successfully. Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Acquiring lock "cinder-dbf7d84a-f15d-4600-a246-62a6c51aaf75-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Lock "cinder-dbf7d84a-f15d-4600-a246-62a6c51aaf75-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Acquiring lock "cinder-quobyte-dbf7d84a-f15d-4600-a246-62a6c51aaf75" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Lock "cinder-quobyte-dbf7d84a-f15d-4600-a246-62a6c51aaf75" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda5d2ff-73e6-42dc-bd31-54654e18f132]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:39 devstack sudo[116130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 Jun 23 14:03:39 devstack sudo[116130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD, size 20.69 MB, duration 5.04 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:03:39 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Image download 20.69 MB at 4.10 MB/s Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543064d-7003-4a18-a312-d2f56643b3df]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:40 devstack sudo[116164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD Jun 23 14:03:40 devstack sudo[116164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:40 devstack sudo[116050]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 1073741824" returned: 0 in 1.910s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:40 devstack sudo[116185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 Jun 23 14:03:40 devstack sudo[116185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:40 devstack sudo[116130]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75" returned: 0 in 1.562s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:40 devstack sudo[116210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75 Jun 23 14:03:40 devstack sudo[116210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:40 devstack sudo[116164]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD" returned: 0 in 1.167s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:40 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Temporary image 4383d24d-f855-4254-ad24-c8bf0c755cb6 is fetched for user 4f6c014006d14d6a94ddfb5dd7608f3c. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b124d4-6f46-461f-97d9-fa31322e82f1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:41 devstack sudo[116218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD Jun 23 14:03:41 devstack sudo[116218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:41 devstack sudo[116185]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6" returned: 0 in 1.169s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] <== create_volume: return (3152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.162s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02013d77-28ad-4369-aadf-bef7f4bb2d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503e50ca-2440-4ccd-87f5-33c836178fb6', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a59927-0d2f-42e1-9c06-c1da134143ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:41 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Volume volume-503e50ca-2440-4ccd-87f5-33c836178fb6 (503e50ca-2440-4ccd-87f5-33c836178fb6): created successfully Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a59927-0d2f-42e1-9c06-c1da134143ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Flow 'volume_create_manager' (686503bd-a8c1-417f-9991-dcf6dc3a3832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-caa981c2-6bd4-4f7c-88e3-8afcd928f128 tempest-VolumesListAdminTestJSON-764097641 None] Created volume successfully. Jun 23 14:03:41 devstack sudo[116210]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dbf7d84a-f15d-4600-a246-62a6c51aaf75" returned: 0 in 1.011s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Lock "cinder-quobyte-dbf7d84a-f15d-4600-a246-62a6c51aaf75" released by "delete_volume" :: held 2.674s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:41 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Created reservations ['88fc0205-0f47-4eae-8bf5-50a3afca314a', '1b61a890-8686-49d6-bccb-e3814344359d', '67e5d84c-e314-4072-86cd-cd6f78412c7b', '3e5cbd04-ebc2-473f-ae21-c8e19b861074'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:42 devstack sudo[116255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:42 devstack sudo[116255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:42 devstack sudo[116218]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD" returned: 0 in 1.488s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1639002548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bc88ff-546e-448b-a86a-1b1d1593077c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624aecc433ce453297b3b0027513e12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:34Z,use_quota=True,user_id='4f6c014006d14d6a94ddfb5dd7608f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25ff2ec4-4eef-4911-a864-58455ef27c6f),volume_type_id=25ff2ec4-4eef-4911-a864-58455ef27c6f)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Creating volume d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:42 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:42 devstack sudo[116274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c 1073741824 Jun 23 14:03:42 devstack sudo[116274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:43 devstack sudo[116255]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.416s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:43 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Deleted volume successfully. Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9bd31f65-5e55-4712-8179-f31dda5075c6 tempest-TestMinimumBasicScenario-1430604347 None] Lock "cinder-dbf7d84a-f15d-4600-a246-62a6c51aaf75-delete_volume" released by "delete_volume" :: held 4.540s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Flow 'volume_create_manager' (fc19d7c7-8489-47d1-9b3a-0ae40e88118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f82b4f3-c778-456c-aedc-49b55d5c71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f82b4f3-c778-456c-aedc-49b55d5c71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a791c71-49b5-4cba-b7ef-027522f140f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af7c9dd24c74443b301a7c0aa93a7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:44Z,use_quota=True,user_id='c3f287621d844703911460d838d7c25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a6f417-fb5f-4f3c-80dd-9ff40c5643be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a6f417-fb5f-4f3c-80dd-9ff40c5643be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bf802e-76ac-4200-90c5-7ae83c48d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bf802e-76ac-4200-90c5-7ae83c48d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a791c71-49b5-4cba-b7ef-027522f140f0', 'volume_name': 'volume-6a791c71-49b5-4cba-b7ef-027522f140f0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6356e556-a80b-4baa-b1a5-c80f148d6cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6356e556-a80b-4baa-b1a5-c80f148d6cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b42f77a-ec2d-4612-b8ba-f0c2eb9adff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Volume 6a791c71-49b5-4cba-b7ef-027522f140f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a791c71-49b5-4cba-b7ef-027522f140f0', 'volume_size': 1} Jun 23 14:03:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:44 devstack sudo[116274]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c 1073741824" returned: 0 in 1.735s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:44 devstack sudo[116360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:03:44 devstack sudo[116360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:45 devstack sudo[116360]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 0 in 0.980s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] <== create_volume: return (2799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.810s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a791c71-49b5-4cba-b7ef-027522f140f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af7c9dd24c74443b301a7c0aa93a7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:44Z,use_quota=True,user_id='c3f287621d844703911460d838d7c25c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Creating volume 6a791c71-49b5-4cba-b7ef-027522f140f0 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:45 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:45 devstack sudo[116401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 1073741824 Jun 23 14:03:45 devstack sudo[116401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Attempting download of 4383d24d-f855-4254-ad24-c8bf0c755cb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4383d24d-f855-4254-ad24-c8bf0c755cb6', 'metadata': {}}])) to volume d6bc88ff-546e-448b-a86a-1b1d1593077c. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a262292e-81dc-4cc6-b72e-c8b1f39f59d1]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:45 devstack sudo[116406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh Jun 23 14:03:45 devstack sudo[116406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:46 devstack sudo[116401]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 1073741824" returned: 0 in 1.135s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:46 devstack sudo[116453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 Jun 23 14:03:46 devstack sudo[116453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:46 devstack sudo[116406]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh" returned: 0 in 1.217s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:46 devstack sudo[116457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh Jun 23 14:03:46 devstack sudo[116457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:47 devstack sudo[116453]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0" returned: 0 in 0.824s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b42f77a-ec2d-4612-b8ba-f0c2eb9adff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a791c71-49b5-4cba-b7ef-027522f140f0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6379cad0-db8e-49b9-9fb2-fcfd120e56c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:47 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Volume volume-6a791c71-49b5-4cba-b7ef-027522f140f0 (6a791c71-49b5-4cba-b7ef-027522f140f0): created successfully Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6379cad0-db8e-49b9-9fb2-fcfd120e56c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Flow 'volume_create_manager' (fc19d7c7-8489-47d1-9b3a-0ae40e88118e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-070da4f1-c105-4711-b195-7f4bca158d69 tempest-VolumesListAdminTestJSON-1962231576 None] Created volume successfully. Jun 23 14:03:47 devstack sudo[116457]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh" returned: 1 in 0.978s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4383d24d-f855-4254-ad24-c8bf0c755cb6_fu_uggbh' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ac1b2-adab-4c28-b053-1b11699dcd08]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:47 devstack sudo[116492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD Jun 23 14:03:47 devstack sudo[116492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Acquiring lock "cinder-6a791c71-49b5-4cba-b7ef-027522f140f0-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "cinder-6a791c71-49b5-4cba-b7ef-027522f140f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Acquiring lock "cinder-quobyte-6a791c71-49b5-4cba-b7ef-027522f140f0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "cinder-quobyte-6a791c71-49b5-4cba-b7ef-027522f140f0" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08a39c-089a-466c-9a58-376e358f6f93]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "cinder-503e50ca-2440-4ccd-87f5-33c836178fb6-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-503e50ca-2440-4ccd-87f5-33c836178fb6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "cinder-quobyte-503e50ca-2440-4ccd-87f5-33c836178fb6" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-quobyte-503e50ca-2440-4ccd-87f5-33c836178fb6" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:48 devstack sudo[116515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de62b4c-6d4a-4413-956a-024886590629]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:48 devstack sudo[116515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:48 devstack sudo[116526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 Jun 23 14:03:48 devstack sudo[116526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:48 devstack sudo[116492]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD" returned: 0 in 1.250s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] 4383d24d-f855-4254-ad24-c8bf0c755cb6 was qcow2, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:03:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:49 devstack sudo[116540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:03:49 devstack sudo[116540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:49 devstack sudo[116515]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0" returned: 0 in 1.105s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:49 devstack sudo[116561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0 Jun 23 14:03:49 devstack sudo[116561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:50 devstack sudo[116526]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6" returned: 0 in 1.348s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:50 devstack sudo[116597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6 Jun 23 14:03:50 devstack sudo[116597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:50 devstack sudo[116561]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a791c71-49b5-4cba-b7ef-027522f140f0" returned: 0 in 1.014s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "cinder-quobyte-6a791c71-49b5-4cba-b7ef-027522f140f0" released by "delete_volume" :: held 2.201s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Created reservations ['88861773-fe17-4510-8e9a-cb12d27f54e9', '8707bb65-1f4f-4a92-b361-2a360508b34d', 'f78cd883-a16a-4f4d-8b0a-af260fba089b', '9fefec29-f321-4cde-ab4c-e45581e01c5e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:50 devstack sudo[116627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:50 devstack sudo[116627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:51 devstack sudo[116597]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-503e50ca-2440-4ccd-87f5-33c836178fb6" returned: 0 in 1.241s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-quobyte-503e50ca-2440-4ccd-87f5-33c836178fb6" released by "delete_volume" :: held 2.652s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Created reservations ['394c3529-22d6-4371-820a-a154fc473826', '131715ad-5523-441d-85a8-272253f2dc0e', '13db5204-0b88-4349-92df-c51a61c0e272', 'f65cbf36-f7d7-4fcb-bf6c-c5c0d9c29f05'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:51 devstack sudo[116648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:51 devstack sudo[116648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:51 devstack sudo[116627]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.985s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:51 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Deleted volume successfully. Jun 23 14:03:52 devstack sudo[116540]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-56ffc18d-fd70-4b07-8e66-f3a2a423b433 tempest-VolumesListAdminTestJSON-1962231576 None] Lock "cinder-6a791c71-49b5-4cba-b7ef-027522f140f0-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 0 in 3.047s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4383d24d-f855-4254-ad24-c8bf0c755cb6_vhpxzibtdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:03:52 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Converted 112.00 MB image at 36.74 MB/s Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:52 devstack sudo[116666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c 1G Jun 23 14:03:52 devstack sudo[116666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "cinder-315de9a8-36e9-480a-9d6a-cf832dfd17aa-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-315de9a8-36e9-480a-9d6a-cf832dfd17aa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "cinder-quobyte-315de9a8-36e9-480a-9d6a-cf832dfd17aa" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-quobyte-315de9a8-36e9-480a-9d6a-cf832dfd17aa" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59d0805-ba88-4683-9700-b031864c7c6b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:52 devstack sudo[116677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa Jun 23 14:03:52 devstack sudo[116677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:52 devstack sudo[116648]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.441s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:52 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:52 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Deleted volume successfully. Jun 23 14:03:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c8a888bb-8d4d-46c0-a5ad-d8882c709bfd tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-503e50ca-2440-4ccd-87f5-33c836178fb6-delete_volume" released by "delete_volume" :: held 4.447s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:53 devstack sudo[116666]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c 1G" returned: 0 in 1.409s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d5abd-ca1b-4aad-b6af-cf310c2a7f30]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:53 devstack sudo[116677]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa" returned: 0 in 1.253s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:53 devstack sudo[116719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:03:53 devstack sudo[116719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:53 devstack sudo[116724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa Jun 23 14:03:53 devstack sudo[116724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:54 devstack sudo[116724]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-315de9a8-36e9-480a-9d6a-cf832dfd17aa" returned: 0 in 0.938s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-quobyte-315de9a8-36e9-480a-9d6a-cf832dfd17aa" released by "delete_volume" :: held 2.266s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:54 devstack sudo[116719]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 0 in 1.088s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Created reservations ['b82ecb2a-a11d-4071-8706-2f2da592d05a', 'ed79109c-8295-4362-bcec-1b771bba7ff1', 'a718dd7e-f998-493a-8dbd-db0955a74f0a', 'b5d61735-a555-47c7-9f9c-7b174f0e4720'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:54 devstack sudo[116784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:03:54 devstack sudo[116784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:54 devstack sudo[116790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:54 devstack sudo[116790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "cinder-80278729-f903-4a01-8aa5-42774bcec7a2-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-80278729-f903-4a01-8aa5-42774bcec7a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:55 devstack sudo[116784]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 1 in 1.076s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Downloaded image 4383d24d-f855-4254-ad24-c8bf0c755cb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4383d24d-f855-4254-ad24-c8bf0c755cb6', 'metadata': {}}])) to volume d6bc88ff-546e-448b-a86a-1b1d1593077c successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Temporary image 4383d24d-f855-4254-ad24-c8bf0c755cb6 for user 4f6c014006d14d6a94ddfb5dd7608f3c is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Marking volume d6bc88ff-546e-448b-a86a-1b1d1593077c as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:03:55 devstack sudo[116790]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.956s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Deleted volume successfully. Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Copying metadata from image 4383d24d-f855-4254-ad24-c8bf0c755cb6 to d6bc88ff-546e-448b-a86a-1b1d1593077c. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Creating volume glance metadata for volume d6bc88ff-546e-448b-a86a-1b1d1593077c backed by image 4383d24d-f855-4254-ad24-c8bf0c755cb6 with: {'image_id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'image_name': 'tempest-scenario-img--2069833186', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "cinder-quobyte-80278729-f903-4a01-8aa5-42774bcec7a2" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c38016f-3275-4fd4-a011-e22e44eaca55 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-315de9a8-36e9-480a-9d6a-cf832dfd17aa-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-quobyte-80278729-f903-4a01-8aa5-42774bcec7a2" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8507c1a2-974a-4321-9729-bc1cf04b865c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afb8302-7201-47a9-9f7c-18676ae2b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bc88ff-546e-448b-a86a-1b1d1593077c', 'volume_size': 1, 'image_id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4383d24d-f855-4254-ad24-c8bf0c755cb6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2069833186', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '624aecc433ce453297b3b0027513e12e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4383d24d-f855-4254-ad24-c8bf0c755cb6', 'created_at': datetime.datetime(2026, 6, 23, 12, 3, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 3, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4383d24d-f855-4254-ad24-c8bf0c755cb6/file', 'properties': {}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3e9b72-d545-46a1-b715-d3e11cc19e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Volume volume-d6bc88ff-546e-448b-a86a-1b1d1593077c (d6bc88ff-546e-448b-a86a-1b1d1593077c): created successfully Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3e9b72-d545-46a1-b715-d3e11cc19e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Flow 'volume_create_manager' (afae9c75-59ed-461f-bf67-f8aab6812c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e58cf10c-74fc-4c5f-98b6-532d737ba9ef tempest-TestInstancesWithCinderVolumes-611890464 None] Created volume successfully. Jun 23 14:03:56 devstack sudo[116832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 Jun 23 14:03:56 devstack sudo[116832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:56 devstack sudo[116832]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2" returned: 0 in 0.909s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:56 devstack sudo[116865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2 Jun 23 14:03:56 devstack sudo[116865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:57 devstack sudo[116865]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80278729-f903-4a01-8aa5-42774bcec7a2" returned: 0 in 0.832s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-quobyte-80278729-f903-4a01-8aa5-42774bcec7a2" released by "delete_volume" :: held 1.798s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Created reservations ['0fc51772-cced-47ca-88ff-ae9d4b9de0d6', '63b40d07-743b-4d68-917b-4cd571049bbb', '3f8cd095-ef87-4920-be1b-5d8eba13bddd', 'b704c063-c968-461e-b9b9-50fde382f926'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:57 devstack sudo[116902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:03:57 devstack sudo[116902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:58 devstack sudo[116902]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.950s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:58 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Deleted volume successfully. Jun 23 14:03:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8d4658e5-d5ad-4517-8a0d-833b810f1d68 tempest-VolumesListAdminTestJSON-764097641 None] Lock "cinder-80278729-f903-4a01-8aa5-42774bcec7a2-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:04 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ddb333-ed80-4631-809c-8027c4a3ba69]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:04 devstack sudo[117115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:04:04 devstack sudo[117115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Flow 'volume_create_manager' (bc30378b-a0dd-49b3-a173-4ef716cc9235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e925445b-4c70-44a8-9cdc-01eebdf1b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e925445b-4c70-44a8-9cdc-01eebdf1b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1915278018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75c01b1-f821-4412-ac79-5cf443a42b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02d6e3b160412f833272464b7b8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:06Z,use_quota=True,user_id='382bf4ec67484dd2ab9eb1a4ea9d779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94adeba8-a28b-40be-9d8c-3be760110d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94adeba8-a28b-40be-9d8c-3be760110d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7feacf6-4762-4782-8ae6-b7e43d8acd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7feacf6-4762-4782-8ae6-b7e43d8acd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75c01b1-f821-4412-ac79-5cf443a42b17', 'volume_name': 'volume-f75c01b1-f821-4412-ac79-5cf443a42b17', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1ffe9-53ab-45a9-b364-6d54495e0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1ffe9-53ab-45a9-b364-6d54495e0af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731b7fa-904a-4074-be7a-c21d42bcda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Volume f75c01b1-f821-4412-ac79-5cf443a42b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75c01b1-f821-4412-ac79-5cf443a42b17', 'volume_size': 1} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:05 devstack sudo[117115]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 0 in 1.377s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:06 devstack sudo[117170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:04:06 devstack sudo[117170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Flow 'volume_create_manager' (7085f07d-c6fb-48c8-b79f-bc5fe177d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4848fab6-87a1-4682-b212-c37410b496fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4848fab6-87a1-4682-b212-c37410b496fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1596440013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d96b4b-c241-482f-8fcb-49d6262472c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee43e735b5b47e1b06dcc3b6bed6883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:06Z,use_quota=True,user_id='ec958eb1cfc54b3ebc61da30c8ade66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae20db3-f8f9-4788-b31d-41f2e9737430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae20db3-f8f9-4788-b31d-41f2e9737430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c9284-a1f1-488c-92c9-23fc0fa16710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c9284-a1f1-488c-92c9-23fc0fa16710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d96b4b-c241-482f-8fcb-49d6262472c4', 'volume_name': 'volume-50d96b4b-c241-482f-8fcb-49d6262472c4', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76922da-e4a4-461d-9285-5471729c78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76922da-e4a4-461d-9285-5471729c78c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1c3cc3-9394-4bac-8235-790a62be897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Volume 50d96b4b-c241-482f-8fcb-49d6262472c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d96b4b-c241-482f-8fcb-49d6262472c4', 'volume_size': 1} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:06 devstack sudo[117170]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 1 in 1.029s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.465s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1915278018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75c01b1-f821-4412-ac79-5cf443a42b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef02d6e3b160412f833272464b7b8dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:06Z,use_quota=True,user_id='382bf4ec67484dd2ab9eb1a4ea9d779d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Creating volume f75c01b1-f821-4412-ac79-5cf443a42b17 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:06 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:04:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:06 devstack sudo[117205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 1073741824 Jun 23 14:04:06 devstack sudo[117205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-d6bc88ff-546e-448b-a86a-1b1d1593077c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '880caaf2-19f4-4fc6-93d3-997e9d387058', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:04:07 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-6893bd49-7bb1-40b5-b136-5f80dc8c4034 req-4a75f93b-2968-4c80-bd86-22daa19d07ae tempest-TestInstancesWithCinderVolumes-611890464 None] attachment_update completed successfully. Jun 23 14:04:07 devstack sudo[117205]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 1073741824" returned: 0 in 0.955s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:07 devstack sudo[117241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 Jun 23 14:04:07 devstack sudo[117241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:08 devstack sudo[117241]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17" returned: 0 in 0.755s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1596440013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d96b4b-c241-482f-8fcb-49d6262472c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee43e735b5b47e1b06dcc3b6bed6883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:06Z,use_quota=True,user_id='ec958eb1cfc54b3ebc61da30c8ade66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Creating volume 50d96b4b-c241-482f-8fcb-49d6262472c4 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:08 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:08 devstack sudo[117268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 1073741824 Jun 23 14:04:08 devstack sudo[117268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b731b7fa-904a-4074-be7a-c21d42bcda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75c01b1-f821-4412-ac79-5cf443a42b17', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5876eceb-3f51-43fa-8aae-ff434267a10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Volume volume-f75c01b1-f821-4412-ac79-5cf443a42b17 (f75c01b1-f821-4412-ac79-5cf443a42b17): created successfully Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5876eceb-3f51-43fa-8aae-ff434267a10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Flow 'volume_create_manager' (bc30378b-a0dd-49b3-a173-4ef716cc9235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:08 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-12bde8d0-006e-4f85-b832-fd64f10b9c31 tempest-AbsoluteLimitsTests-738485745 None] Created volume successfully. Jun 23 14:04:09 devstack sudo[117268]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 1073741824" returned: 0 in 1.032s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:09 devstack sudo[117374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 Jun 23 14:04:09 devstack sudo[117374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Acquiring lock "cinder-f75c01b1-f821-4412-ac79-5cf443a42b17-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Lock "cinder-f75c01b1-f821-4412-ac79-5cf443a42b17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Acquiring lock "cinder-quobyte-f75c01b1-f821-4412-ac79-5cf443a42b17" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Lock "cinder-quobyte-f75c01b1-f821-4412-ac79-5cf443a42b17" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[201162de-8fed-424a-adb6-79c8de65a8a1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:10 devstack sudo[117385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 Jun 23 14:04:10 devstack sudo[117385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:10 devstack sudo[117374]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4" returned: 0 in 0.777s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1c3cc3-9394-4bac-8235-790a62be897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d96b4b-c241-482f-8fcb-49d6262472c4', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cdd601-dc55-40e7-9051-cfbc38cbd380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:10 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Volume volume-50d96b4b-c241-482f-8fcb-49d6262472c4 (50d96b4b-c241-482f-8fcb-49d6262472c4): created successfully Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cdd601-dc55-40e7-9051-cfbc38cbd380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Flow 'volume_create_manager' (7085f07d-c6fb-48c8-b79f-bc5fe177d52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:10 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e7a954a1-84af-40b3-9f87-55a2011d1db8 tempest-AttachVolumeNegativeTest-1216548935 None] Created volume successfully. Jun 23 14:04:11 devstack sudo[117385]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17" returned: 0 in 0.882s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:11 devstack sudo[117422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17 Jun 23 14:04:11 devstack sudo[117422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:11 devstack sudo[117422]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f75c01b1-f821-4412-ac79-5cf443a42b17" returned: 0 in 0.895s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Lock "cinder-quobyte-f75c01b1-f821-4412-ac79-5cf443a42b17" released by "delete_volume" :: held 1.851s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Created reservations ['20596e7c-22ff-41d0-8cd7-01dfceb1da5b', '3026f0d6-97ee-408d-b4bf-da2440742bb1', '3da21ec0-6ec9-43b9-a8e9-c1a1ed932207', 'd2c23c86-257e-4760-b4c9-160fd66e419f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:12 devstack sudo[117769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:04:12 devstack sudo[117769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:13 devstack sudo[117769]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.930s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:13 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Deleted volume successfully. Jun 23 14:04:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5c10ec9f-a5e4-40be-a41e-0d5bf7e962ac tempest-AbsoluteLimitsTests-738485745 None] Lock "cinder-f75c01b1-f821-4412-ac79-5cf443a42b17-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:15 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb5d9fa-eb2d-476a-837f-d70dd794b8ca]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:15 devstack sudo[117953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 Jun 23 14:04:15 devstack sudo[117953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:16 devstack sudo[117953]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4" returned: 0 in 1.619s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.655s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-50d96b4b-c241-482f-8fcb-49d6262472c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73aecf6a-5cd3-4b53-b291-6a2b1e3b1ed2', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:04:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-74e590ae-c6bb-42e4-a98e-b601955aa3e8 req-36b31156-2190-4093-9ca5-bbfbcedba584 tempest-AttachVolumeNegativeTest-1216548935 None] attachment_update completed successfully. Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=75,cinder:INSERT=17,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=80,cinder:SELECT=57,cinder:INSERT=25,cinder:DELETE=9 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Flow 'volume_create_manager' (1b5b0402-a1b1-461c-83c9-6671660d95d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b4aa41-aa87-4a72-8b52-03369f8e3d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b4aa41-aa87-4a72-8b52-03369f8e3d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-268792917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba915df3624f4e0d9ffc51ca57c0e695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:24Z,use_quota=True,user_id='7e2f51bab090436cb974a555990fc514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b966e83-596b-4451-9770-a6f254a57b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b966e83-596b-4451-9770-a6f254a57b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3a19ff-7f4f-4aa0-b782-5e82efa45208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3a19ff-7f4f-4aa0-b782-5e82efa45208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa', 'volume_name': 'volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05624a4b-437e-4f2e-bc1d-94493047cd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05624a4b-437e-4f2e-bc1d-94493047cd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea37bc7-0976-4594-85ad-44e5e0e7d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:24 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Volume f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa', 'volume_size': 1} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-268792917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba915df3624f4e0d9ffc51ca57c0e695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:24Z,use_quota=True,user_id='7e2f51bab090436cb974a555990fc514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Creating volume f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:24 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:24 devstack sudo[118244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa 1073741824 Jun 23 14:04:24 devstack sudo[118244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-0fda5aee-18c9-47b1-8fc6-6f1ed2c6c405 req-c6773f9b-1940-4984-81d8-4249a6411e15 tempest-AttachVolumeNegativeTest-1216548935 None] Terminate volume connection completed successfully. Jun 23 14:04:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-0fda5aee-18c9-47b1-8fc6-6f1ed2c6c405 req-c6773f9b-1940-4984-81d8-4249a6411e15 tempest-AttachVolumeNegativeTest-1216548935 None] Deleting attachment 73aecf6a-5cd3-4b53-b291-6a2b1e3b1ed2. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:04:26 devstack sudo[118244]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa 1073741824" returned: 0 in 1.753s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:26 devstack sudo[118311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa Jun 23 14:04:26 devstack sudo[118311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:27 devstack sudo[118311]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" returned: 0 in 1.257s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] <== create_volume: return (3110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.116s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea37bc7-0976-4594-85ad-44e5e0e7d14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8203c1d0-1f38-4586-b1e1-49381401f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:27 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Volume volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa (f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa): created successfully Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8203c1d0-1f38-4586-b1e1-49381401f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Flow 'volume_create_manager' (1b5b0402-a1b1-461c-83c9-6671660d95d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8e6f2e36-46cc-4976-883a-14a60dd4b607 tempest-VolumesDeleteCascade-316106258 None] Created volume successfully. Jun 23 14:04:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:29 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Creating offline snapshot 94adf33e-b7ee-470f-82be-d9de185843e0 of volume f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:04:29 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc58b0-14bf-4b28-8008-edb3cb8391eb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:29 devstack sudo[118438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa Jun 23 14:04:29 devstack sudo[118438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:30 devstack sudo[118438]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" returned: 0 in 1.239s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:30 devstack sudo[118505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 1G Jun 23 14:04:30 devstack sudo[118505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:31 devstack sudo[118505]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 1G" returned: 0 in 1.349s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:31 devstack sudo[118555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:31 devstack sudo[118555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:32 devstack sudo[118573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:04:32 devstack sudo[118573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:33 devstack sudo[118555]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 1.435s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:33 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 is being set with open permissions: ugo+rw Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:33 devstack sudo[118685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:33 devstack sudo[118685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:33 devstack sudo[118573]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.166s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:04:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:04:34 devstack sudo[118685]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 1.113s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:34 devstack sudo[118722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info Jun 23 14:04:34 devstack sudo[118722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:35 devstack sudo[118722]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info" returned: 0 in 1.077s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:35 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info is being set with open permissions: ugo+rw Jun 23 14:04:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:35 devstack sudo[118761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info Jun 23 14:04:35 devstack sudo[118761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:36 devstack sudo[118761]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.info" returned: 0 in 0.870s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.232s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-05970578-6945-4e23-8942-60522f6817b4 tempest-VolumesDeleteCascade-316106258 None] Create snapshot completed successfully Jun 23 14:04:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Creating offline snapshot 0d8354d1-676a-4127-9a62-4c327f216875 of volume f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:04:37 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a2635b-cf80-42e5-8e2a-673a7d176633]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:37 devstack sudo[118848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:37 devstack sudo[118848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:38 devstack sudo[118848]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 0.964s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:04:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:38 devstack sudo[118883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 1G Jun 23 14:04:38 devstack sudo[118883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:39 devstack sudo[118883]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 1G" returned: 0 in 1.269s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:39 devstack sudo[118928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 Jun 23 14:04:39 devstack sudo[118928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:40 devstack sudo[118928]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875" returned: 0 in 0.896s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:40 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 is being set with open permissions: ugo+rw Jun 23 14:04:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:40 devstack sudo[118958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 Jun 23 14:04:40 devstack sudo[118958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:41 devstack sudo[118958]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875" returned: 0 in 0.765s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.090s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-be5d0598-ffe6-4bd3-9cdb-60427f242521 tempest-VolumesDeleteCascade-316106258 None] Create snapshot completed successfully Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Performing cascade delete. {{(pid=93689) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-0d8354d1-676a-4127-9a62-4c327f216875-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-0d8354d1-676a-4127-9a62-4c327f216875-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-0d8354d1-676a-4127-9a62-4c327f216875" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-0d8354d1-676a-4127-9a62-4c327f216875" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Deleting offline snapshot 0d8354d1-676a-4127-9a62-4c327f216875 of volume f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] snapshot_file for this snap is: volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[658757fe-4ab0-4243-9757-b1872bf473de]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:41 devstack sudo[119003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 Jun 23 14:04:41 devstack sudo[119003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:42 devstack sudo[119003]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875" returned: 0 in 1.068s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:04:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[57362069-cb19-4487-bed4-d213218ae5b0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:42 devstack sudo[119044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:42 devstack sudo[119044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Flow 'volume_create_manager' (d706cd80-cdf8-4b1f-a687-52067854eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08de6809-be29-4cef-92f8-fbff0f93fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08de6809-be29-4cef-92f8-fbff0f93fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1344473015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da9f7ab-6627-4bf1-b1f9-63a8f853ad82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ca896b8e0b42dbbecad3e5798fe6b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:43Z,use_quota=True,user_id='a2bcfb16b339482081586b4688dd25c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fb8831-6c8a-47f5-8a2d-b374621cc136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fb8831-6c8a-47f5-8a2d-b374621cc136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35b613-78b4-4cb4-b66b-761d90a8b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:43 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35b613-78b4-4cb4-b66b-761d90a8b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0da9f7ab-6627-4bf1-b1f9-63a8f853ad82', 'volume_name': 'volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fa3d25-1c45-47e6-b9de-074034af0e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fa3d25-1c45-47e6-b9de-074034af0e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f97aa0-9a4f-4a31-be70-5a2421f3d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:44 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Volume 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Trying to clone 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:04:44 devstack sudo[119044]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 1.393s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:44 devstack sudo[119093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 Jun 23 14:04:44 devstack sudo[119093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:04:44 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef62e3-d401-4087-84b8-eb28191d0df4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:45 devstack sudo[119116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD Jun 23 14:04:45 devstack sudo[119116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:45 devstack sudo[119093]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875" returned: 0 in 1.266s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:45 devstack sudo[119139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875 Jun 23 14:04:45 devstack sudo[119139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:45 devstack sudo[119116]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD" returned: 0 in 0.908s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:45 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed is fetched for user a2bcfb16b339482081586b4688dd25c4. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:04:45 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be9034-055f-40e9-a0c1-4d31860f79d4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:46 devstack sudo[119156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD Jun 23 14:04:46 devstack sudo[119156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:46 devstack sudo[119139]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.0d8354d1-676a-4127-9a62-4c327f216875" returned: 0 in 0.714s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-0d8354d1-676a-4127-9a62-4c327f216875" released by "_delete_snapshot" :: held 4.615s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" released by "delete_snapshot" :: held 4.654s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Created reservations ['b4e0d38e-709f-4602-b756-6f63d57132ca', 'ea4c82de-7f28-46cf-9e77-4b07e346ffe2', '50273314-102c-45ca-baed-8f80e0df72f0', 'efedd904-6fef-4344-a407-1fd5b438a3c2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Delete snapshot completed successfully. Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-0d8354d1-676a-4127-9a62-4c327f216875-delete_snapshot" released by "delete_snapshot" :: held 4.840s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-94adf33e-b7ee-470f-82be-d9de185843e0-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-94adf33e-b7ee-470f-82be-d9de185843e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-94adf33e-b7ee-470f-82be-d9de185843e0" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-94adf33e-b7ee-470f-82be-d9de185843e0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Deleting offline snapshot 94adf33e-b7ee-470f-82be-d9de185843e0 of volume f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] snapshot_file for this snap is: volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c78baef-44e1-4292-a571-7b7e8cb150b0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:46 devstack sudo[119178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:46 devstack sudo[119178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:46 devstack sudo[119156]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD" returned: 0 in 0.843s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1344473015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da9f7ab-6627-4bf1-b1f9-63a8f853ad82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ca896b8e0b42dbbecad3e5798fe6b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:43Z,use_quota=True,user_id='a2bcfb16b339482081586b4688dd25c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Creating volume 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:46 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:04:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:46 devstack sudo[119192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 1073741824 Jun 23 14:04:46 devstack sudo[119192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:47 devstack sudo[119178]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 0.842s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:04:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc37e04e-d034-4ed8-9106-7db0804aae7e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:47 devstack sudo[119219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa Jun 23 14:04:47 devstack sudo[119219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:47 devstack sudo[119192]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 1073741824" returned: 0 in 0.871s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:47 devstack sudo[119232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:04:47 devstack sudo[119232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:48 devstack sudo[119219]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" returned: 0 in 0.922s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:48 devstack sudo[119255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:48 devstack sudo[119255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:48 devstack sudo[119232]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 0.758s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Attempting download of 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae339698-165c-486a-9da0-57ec955b174a]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:48 devstack sudo[119266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4 Jun 23 14:04:48 devstack sudo[119266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:49 devstack sudo[119255]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 1.228s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:49 devstack sudo[119306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0 Jun 23 14:04:49 devstack sudo[119306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:49 devstack sudo[119266]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4" returned: 0 in 1.209s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:49 devstack sudo[119319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4 Jun 23 14:04:49 devstack sudo[119319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:50 devstack sudo[119306]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa.94adf33e-b7ee-470f-82be-d9de185843e0" returned: 0 in 0.925s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-94adf33e-b7ee-470f-82be-d9de185843e0" released by "_delete_snapshot" :: held 4.046s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" released by "delete_snapshot" :: held 4.084s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Created reservations ['40ea57eb-e8b4-4e82-babf-6522fcb694cd', '379422a4-1110-4af6-a57c-2f5c929a541b', 'cc18fd0b-0ed1-4bd0-be2c-3fae46ad856c', 'e4a724b8-9d4d-4545-b426-9f542fe86bb8'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Delete snapshot completed successfully. Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-94adf33e-b7ee-470f-82be-d9de185843e0-delete_snapshot" released by "delete_snapshot" :: held 4.340s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Snapshots deleted, issuing volume delete {{(pid=93689) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d7241-97c4-426a-93ac-28f2921e66b7]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:50 devstack sudo[119319]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4" returned: 1 in 1.153s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_jx7gbly4' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b871ff1-61ca-4137-81f4-93ec9eb2e226]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:50 devstack sudo[119371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa Jun 23 14:04:50 devstack sudo[119371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:50 devstack sudo[119375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD Jun 23 14:04:50 devstack sudo[119375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:51 devstack sudo[119371]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" returned: 0 in 0.897s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:51 devstack sudo[119408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa Jun 23 14:04:51 devstack sudo[119408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:51 devstack sudo[119375]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD" returned: 0 in 0.943s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:51 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] 0ba7d2d6-fbde-443c-96de-e07fd76adfed was qcow2, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:04:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:51 devstack sudo[119413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:04:51 devstack sudo[119413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:52 devstack sudo[119408]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" returned: 0 in 0.778s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa" released by "delete_volume" :: held 1.760s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6ed7a0-b5cc-4283-97ab-708da5433873]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Created reservations ['fddfecca-f4aa-4a17-b62f-217045e54772', 'f47044bd-97bd-4ef6-8258-2b1e62e4e54e', 'd766cb07-fa47-4779-9104-810f5a8b7679', '4f047005-ca62-4807-a0fe-f1d5ac6a584c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:52 devstack sudo[119448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b Jun 23 14:04:52 devstack sudo[119448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:52 devstack sudo[119463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:04:52 devstack sudo[119463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:53 devstack sudo[119463]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:53 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Deleted volume successfully. Jun 23 14:04:53 devstack sudo[119448]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" returned: 0 in 1.138s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.165s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9000557-0ccc-45e6-b794-b5e84c4ab494 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-f32c433e-17d3-45bb-ba0d-8d64b2f6d5aa-delete_volume" released by "delete_volume" :: held 12.305s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d47b84d-079d-44d4-9003-9d3fd33c085b', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:04:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-4e0d6d82-56d9-4179-a347-92a3221475be req-a7e4ca36-c196-4a85-a2ed-73d4eb625149 tempest-TestInstancesWithCinderVolumes-611890464 None] attachment_update completed successfully. Jun 23 14:04:54 devstack sudo[119413]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 2.619s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lx1lk2w7devstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:04:54 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Converted 112.00 MB image at 42.75 MB/s Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:54 devstack sudo[119524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 1G Jun 23 14:04:54 devstack sudo[119524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Flow 'volume_create_manager' (d105f4ca-dece-4481-97cc-6a146c10c19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762cc8f6-fd05-400c-bcee-3a6d151fbf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762cc8f6-fd05-400c-bcee-3a6d151fbf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-935851402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f057e24-6264-4411-a114-51df49f1d969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba915df3624f4e0d9ffc51ca57c0e695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:54Z,use_quota=True,user_id='7e2f51bab090436cb974a555990fc514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34acbe6f-4a0f-4917-bc17-7ed4417994b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34acbe6f-4a0f-4917-bc17-7ed4417994b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0500bf4-dcc3-4712-a19d-c1bb3285d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0500bf4-dcc3-4712-a19d-c1bb3285d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f057e24-6264-4411-a114-51df49f1d969', 'volume_name': 'volume-0f057e24-6264-4411-a114-51df49f1d969', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817e4cc6-515d-4ece-b952-14a73741f34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817e4cc6-515d-4ece-b952-14a73741f34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe374522-fc2a-4c3b-abe7-36f7398f2d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:54 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Volume 0f057e24-6264-4411-a114-51df49f1d969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f057e24-6264-4411-a114-51df49f1d969', 'volume_size': 1} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-935851402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f057e24-6264-4411-a114-51df49f1d969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba915df3624f4e0d9ffc51ca57c0e695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:54Z,use_quota=True,user_id='7e2f51bab090436cb974a555990fc514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Creating volume 0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:54 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:04:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:54 devstack sudo[119537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 1073741824 Jun 23 14:04:54 devstack sudo[119537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:55 devstack sudo[119524]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 1G" returned: 0 in 0.780s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:55 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f040c73e-9a2e-4424-83dd-c7c4d71aac1a]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:55 devstack sudo[119565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:04:55 devstack sudo[119565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:55 devstack sudo[119537]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 1073741824" returned: 0 in 0.922s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:55 devstack sudo[119579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:04:55 devstack sudo[119579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:56 devstack sudo[119565]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 0.831s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:56 devstack sudo[119601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:04:56 devstack sudo[119601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:56 devstack sudo[119579]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 0.724s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe374522-fc2a-4c3b-abe7-36f7398f2d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f057e24-6264-4411-a114-51df49f1d969', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a655375-28d8-4d85-9e24-e5d75022a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:56 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Volume volume-0f057e24-6264-4411-a114-51df49f1d969 (0f057e24-6264-4411-a114-51df49f1d969): created successfully Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a655375-28d8-4d85-9e24-e5d75022a19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Flow 'volume_create_manager' (d105f4ca-dece-4481-97cc-6a146c10c19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5e767e35-7a8b-4957-a9b1-29102ba84fe9 tempest-VolumesDeleteCascade-316106258 None] Created volume successfully. Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Creating offline snapshot e05ace42-80bf-4377-97ac-2791ddb1d770 of volume 0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac56c29-ae4e-4235-add8-d8e7e9d24aac]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:57 devstack sudo[119681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:04:57 devstack sudo[119681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:57 devstack sudo[119601]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 1 in 1.226s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Downloaded image 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed for user a2bcfb16b339482081586b4688dd25c4 is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Marking volume 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Copying metadata from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed to 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Creating volume glance metadata for volume 0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 backed by image 0ba7d2d6-fbde-443c-96de-e07fd76adfed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f97aa0-9a4f-4a31-be70-5a2421f3d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87c1581-70e2-49c6-8778-c988b0095adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:57 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Volume volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 (0da9f7ab-6627-4bf1-b1f9-63a8f853ad82): created successfully Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87c1581-70e2-49c6-8778-c988b0095adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:57 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Flow 'volume_create_manager' (d706cd80-cdf8-4b1f-a687-52067854eefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6d98f47a-48c4-4f9b-8192-b83905c8dd8b tempest-TestShelveInstance-971418965 None] Created volume successfully. Jun 23 14:04:58 devstack sudo[119681]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 1.319s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:58 devstack sudo[119755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 1G Jun 23 14:04:58 devstack sudo[119755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:59 devstack sudo[119755]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 1G" returned: 0 in 1.449s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f057e24-6264-4411-a114-51df49f1d969 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:59 devstack sudo[119818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f057e24-6264-4411-a114-51df49f1d969 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 Jun 23 14:04:59 devstack sudo[119818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:00 devstack sudo[119818]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f057e24-6264-4411-a114-51df49f1d969 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770" returned: 0 in 0.891s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:00 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 is being set with open permissions: ugo+rw Jun 23 14:05:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:00 devstack sudo[119851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 Jun 23 14:05:00 devstack sudo[119851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:01 devstack sudo[119851]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770" returned: 0 in 0.792s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:01 devstack sudo[119881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info Jun 23 14:05:01 devstack sudo[119881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:02 devstack sudo[119881]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info" returned: 0 in 0.988s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:02 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info is being set with open permissions: ugo+rw Jun 23 14:05:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:02 devstack sudo[119925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info Jun 23 14:05:02 devstack sudo[119925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:03 devstack sudo[119925]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.info" returned: 0 in 0.754s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.375s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:03 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dbb513-a01e-4950-9483-64eff8d0b9a6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-99d2ccc1-fb37-4722-b8a0-1e3a8e725cd3 tempest-VolumesDeleteCascade-316106258 None] Create snapshot completed successfully Jun 23 14:05:03 devstack sudo[119953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 Jun 23 14:05:03 devstack sudo[119953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:04 devstack sudo[119953]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01" returned: 0 in 0.902s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-61d1ea12-a6e9-486f-b245-217798c56e01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fb2ca2f-e1e9-4ae5-b02d-9bf004a7061b', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:05:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-b4623cee-e98e-4a78-bce1-27b4074e1ac5 req-f2bce4d8-7ad9-407d-9723-992dabbb7f80 tempest-TestInstancesWithCinderVolumes-611890464 None] attachment_update completed successfully. Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Flow 'volume_create_manager' (c3d141de-59b2-4258-81a9-2e0717abe819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eef233d-9036-441d-8724-2257c22ba4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eef233d-9036-441d-8724-2257c22ba4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1022041240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebc5783-cbb3-4ec9-8049-5d442af82beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba915df3624f4e0d9ffc51ca57c0e695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e05ace42-80bf-4377-97ac-2791ddb1d770,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:05Z,use_quota=True,user_id='7e2f51bab090436cb974a555990fc514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aaa12ff-a8ec-4430-b132-b5167c84e53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aaa12ff-a8ec-4430-b132-b5167c84e53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f3dd1-a375-43db-b6d9-12bef8e03f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f3dd1-a375-43db-b6d9-12bef8e03f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aebc5783-cbb3-4ec9-8049-5d442af82beb', 'volume_name': 'volume-aebc5783-cbb3-4ec9-8049-5d442af82beb', 'volume_size': 1, 'snapshot_id': 'e05ace42-80bf-4377-97ac-2791ddb1d770'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54680bd7-f623-42be-9c59-744fe951202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54680bd7-f623-42be-9c59-744fe951202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dceb6fc9-4ac1-4122-a588-091b4169c11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Volume aebc5783-cbb3-4ec9-8049-5d442af82beb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aebc5783-cbb3-4ec9-8049-5d442af82beb', 'volume_size': 1, 'snapshot_id': 'e05ace42-80bf-4377-97ac-2791ddb1d770'} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-e05ace42-80bf-4377-97ac-2791ddb1d770-aebc5783-cbb3-4ec9-8049-5d442af82beb" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-e05ace42-80bf-4377-97ac-2791ddb1d770-aebc5783-cbb3-4ec9-8049-5d442af82beb" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Creating volume aebc5783-cbb3-4ec9-8049-5d442af82beb from snapshot e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-aebc5783-cbb3-4ec9-8049-5d442af82beb" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-aebc5783-cbb3-4ec9-8049-5d442af82beb" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] snapshot: e05ace42-80bf-4377-97ac-2791ddb1d770, volume: aebc5783-cbb3-4ec9-8049-5d442af82beb, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1822778-a26a-4bb8-89b8-109b2a0de066]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:05 devstack sudo[120028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 Jun 23 14:05:05 devstack sudo[120028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:06 devstack sudo[120028]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770" returned: 0 in 1.422s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f057e24-6264-4411-a114-51df49f1d969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4974b9-39a7-4b29-9e75-29ccdf8111e2]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:07 devstack sudo[120090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:05:07 devstack sudo[120090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:07 devstack sudo[120090]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 1.012s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:07 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:05:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:07 devstack sudo[120126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb Jun 23 14:05:07 devstack sudo[120126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:14 devstack sudo[120126]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb" returned: 0 in 6.939s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:14 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d44d6-cf9a-4628-9928-d77e4d003402]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:15 devstack sudo[120373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:05:15 devstack sudo[120373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:15 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=48,cinder:INSERT=16,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:05:16 devstack sudo[120373]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 1.220s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:05:16 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Converted 1024.00 MB image at 147.55 MB/s Jun 23 14:05:16 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb is being set with open permissions: ugo+rw Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:16 devstack sudo[120428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb Jun 23 14:05:16 devstack sudo[120428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=59,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=14 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:05:16 devstack sudo[120428]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb" returned: 0 in 0.685s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-aebc5783-cbb3-4ec9-8049-5d442af82beb" released by "_copy_volume_from_snapshot" :: held 11.426s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-e05ace42-80bf-4377-97ac-2791ddb1d770-aebc5783-cbb3-4ec9-8049-5d442af82beb" released by "_create_volume_from_snapshot" :: held 11.466s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.487s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.384s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dceb6fc9-4ac1-4122-a588-091b4169c11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebc5783-cbb3-4ec9-8049-5d442af82beb', 'volume_size': 1, 'snapshot_id': 'e05ace42-80bf-4377-97ac-2791ddb1d770'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a505c808-b9fc-43df-bb5e-090c4c300e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8b6c5-36dd-4fd6-8260-a4b21a7dd8c6]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:16 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Volume volume-aebc5783-cbb3-4ec9-8049-5d442af82beb (aebc5783-cbb3-4ec9-8049-5d442af82beb): created successfully Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a505c808-b9fc-43df-bb5e-090c4c300e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Flow 'volume_create_manager' (c3d141de-59b2-4258-81a9-2e0717abe819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a6ded687-43f5-4e29-be80-9fbfc2ed1fcc tempest-VolumesDeleteCascade-316106258 None] Created volume successfully. Jun 23 14:05:16 devstack sudo[120452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:05:16 devstack sudo[120452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-0f057e24-6264-4411-a114-51df49f1d969-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-0f057e24-6264-4411-a114-51df49f1d969-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Performing cascade delete. {{(pid=93689) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-e05ace42-80bf-4377-97ac-2791ddb1d770-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-e05ace42-80bf-4377-97ac-2791ddb1d770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-0f057e24-6264-4411-a114-51df49f1d969" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-0f057e24-6264-4411-a114-51df49f1d969" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-e05ace42-80bf-4377-97ac-2791ddb1d770" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-e05ace42-80bf-4377-97ac-2791ddb1d770" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Deleting offline snapshot e05ace42-80bf-4377-97ac-2791ddb1d770 of volume 0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] snapshot_file for this snap is: volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[60268fdb-3548-45a5-a58d-3a6422a08ede]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:17 devstack sudo[120471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 Jun 23 14:05:17 devstack sudo[120471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:17 devstack sudo[120452]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 0.927s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-76651c18-72b1-43cc-9dc7-345a93fbf7ec req-8b11679f-2d81-431e-8c76-25f7f4bfc3bf tempest-TestInstancesWithCinderVolumes-611890464 None] Terminate volume connection completed successfully. Jun 23 14:05:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-76651c18-72b1-43cc-9dc7-345a93fbf7ec req-8b11679f-2d81-431e-8c76-25f7f4bfc3bf tempest-TestInstancesWithCinderVolumes-611890464 None] Deleting attachment 0d47b84d-079d-44d4-9003-9d3fd33c085b. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:05:17 devstack sudo[120495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:05:17 devstack sudo[120495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:18 devstack sudo[120471]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770" returned: 0 in 0.913s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f057e24-6264-4411-a114-51df49f1d969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a7c2d1-62ea-4ba1-a1b2-96638cd4b2fe]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:18 devstack sudo[120516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:05:18 devstack sudo[120516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:18 devstack sudo[120495]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 1 in 0.965s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.936s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba1b28e9-44f4-42fc-96f8-0b0d73003c33', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:05:18 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-f77cba2b-8711-4609-aeee-d5326b112ba2 req-57517720-1eb8-43bf-8545-19e3dc77f8de tempest-TestShelveInstance-971418965 None] attachment_update completed successfully. Jun 23 14:05:19 devstack sudo[120516]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 0.903s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:19 devstack sudo[120551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 Jun 23 14:05:19 devstack sudo[120551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "cinder-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "cinder-quobyte-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-quobyte-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d8607d-9271-4989-a6c4-2007b937a7f0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:19 devstack sudo[120572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b Jun 23 14:05:19 devstack sudo[120572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:20 devstack sudo[120551]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770" returned: 0 in 1.095s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:20 devstack sudo[120596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770 Jun 23 14:05:20 devstack sudo[120596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:20 devstack sudo[120572]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" returned: 0 in 1.029s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:20 devstack sudo[120613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b Jun 23 14:05:20 devstack sudo[120613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:21 devstack sudo[120596]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969.e05ace42-80bf-4377-97ac-2791ddb1d770" returned: 0 in 0.851s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-e05ace42-80bf-4377-97ac-2791ddb1d770" released by "_delete_snapshot" :: held 3.892s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-0f057e24-6264-4411-a114-51df49f1d969" released by "delete_snapshot" :: held 3.916s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Created reservations ['0cd2cc1b-db0b-4d19-b111-24e67a8fca79', '314428ae-1e22-4d05-ac2d-a5b776116dcd', '0fd244d5-d53b-4ec7-8364-1cbc418a633d', 'd93addbd-60f2-4b7c-a4b1-480ae80c6204'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Delete snapshot completed successfully. Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-e05ace42-80bf-4377-97ac-2791ddb1d770-delete_snapshot" released by "delete_snapshot" :: held 4.117s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Snapshots deleted, issuing volume delete {{(pid=93689) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-0f057e24-6264-4411-a114-51df49f1d969" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-0f057e24-6264-4411-a114-51df49f1d969" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30492c0-621c-462a-965d-1dd5c07fbdea]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:21 devstack sudo[120613]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" returned: 0 in 0.725s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-quobyte-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b" released by "delete_volume" :: held 1.803s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:21 devstack cinder-volume[93689]: WARNING cinder.quota [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-223481411-256574771 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-223481411-256574771, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:21 devstack cinder-volume[93689]: WARNING cinder.quota [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-223481411-256574771 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-223481411-256574771, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Created reservations ['2f3c5ba3-47f7-4cab-a05b-c88788bbc2b0', '1c032e80-f59d-4d8b-9a06-9696c8418f05', '62704781-4bee-4109-af40-33428d1c6aa2', '80a17695-8eeb-4eeb-87da-91ae04e3abc2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:21 devstack sudo[120638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:05:21 devstack sudo[120638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:21 devstack sudo[120646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:21 devstack sudo[120646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:22 devstack sudo[120638]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 0.946s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:22 devstack sudo[120684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969 Jun 23 14:05:22 devstack sudo[120684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:22 devstack sudo[120646]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.941s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Deleted volume successfully. Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-37ddd837-5a4c-425c-b79b-588569418325 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-6b5cb6bb-4452-4bfc-a0d2-34a0bedb7c6b-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Flow 'volume_create_manager' (347988ac-6143-4431-b7de-54d0d2164086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783e4b63-f550-41ef-b9d9-4a2679715dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783e4b63-f550-41ef-b9d9-4a2679715dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1287722583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df44b24b-ab25-4151-8a37-273204785f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee43e735b5b47e1b06dcc3b6bed6883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:23Z,use_quota=True,user_id='ec958eb1cfc54b3ebc61da30c8ade66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d525285-0bc5-4e6b-924c-d805edfe0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d525285-0bc5-4e6b-924c-d805edfe0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054474a2-0c6d-4825-be79-0d3d634bcaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054474a2-0c6d-4825-be79-0d3d634bcaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df44b24b-ab25-4151-8a37-273204785f8c', 'volume_name': 'volume-df44b24b-ab25-4151-8a37-273204785f8c', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24c2aec-ca73-4785-ab92-182fde2ef113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24c2aec-ca73-4785-ab92-182fde2ef113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ab0dc1-b9c5-403b-8ea9-b06fcd244723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:22 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Volume df44b24b-ab25-4151-8a37-273204785f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df44b24b-ab25-4151-8a37-273204785f8c', 'volume_size': 1} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1287722583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df44b24b-ab25-4151-8a37-273204785f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee43e735b5b47e1b06dcc3b6bed6883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:23Z,use_quota=True,user_id='ec958eb1cfc54b3ebc61da30c8ade66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Creating volume df44b24b-ab25-4151-8a37-273204785f8c {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:22 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:05:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:22 devstack sudo[120716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c 1073741824 Jun 23 14:05:22 devstack sudo[120716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:23 devstack sudo[120684]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0f057e24-6264-4411-a114-51df49f1d969" returned: 0 in 0.833s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-0f057e24-6264-4411-a114-51df49f1d969" released by "delete_volume" :: held 1.852s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Created reservations ['45930e32-9c80-4888-a7f8-aad2f5333a50', '58b7ef6d-87b1-4ebe-9df5-1af738ebfeb9', '467835a3-15d5-4bd9-b1fe-dc4ca7a9e8c4', 'da9ad0b8-08ad-4581-b388-0c11a98744f2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:23 devstack sudo[120738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:23 devstack sudo[120738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:23 devstack sudo[120716]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c 1073741824" returned: 0 in 1.033s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:24 devstack sudo[120773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c Jun 23 14:05:24 devstack sudo[120773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:24 devstack sudo[120738]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.804s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Deleted volume successfully. Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-104a1587-4aab-4c82-8dc0-06c47acdcb8d tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-0f057e24-6264-4411-a114-51df49f1d969-delete_volume" released by "delete_volume" :: held 7.126s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-aebc5783-cbb3-4ec9-8049-5d442af82beb-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-aebc5783-cbb3-4ec9-8049-5d442af82beb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "cinder-quobyte-aebc5783-cbb3-4ec9-8049-5d442af82beb" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-aebc5783-cbb3-4ec9-8049-5d442af82beb" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6574f39-6f6a-460f-88b2-703542286b3f]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:24 devstack sudo[120811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb Jun 23 14:05:24 devstack sudo[120811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:25 devstack sudo[120773]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c" returned: 0 in 1.274s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ab0dc1-b9c5-403b-8ea9-b06fcd244723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df44b24b-ab25-4151-8a37-273204785f8c', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58146adc-8f4a-47aa-b037-317d7329639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:25 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Volume volume-df44b24b-ab25-4151-8a37-273204785f8c (df44b24b-ab25-4151-8a37-273204785f8c): created successfully Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58146adc-8f4a-47aa-b037-317d7329639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Flow 'volume_create_manager' (347988ac-6143-4431-b7de-54d0d2164086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:25 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2b416486-0e92-492c-b0ff-d25ab4e3d65e tempest-AttachVolumeNegativeTest-1216548935 None] Created volume successfully. Jun 23 14:05:25 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-58077459-f937-4367-815e-77161bf077d7 req-b09f6cfb-72c4-4425-afe7-bfc687d4dbbd tempest-TestInstancesWithCinderVolumes-611890464 None] Terminate volume connection completed successfully. Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-58077459-f937-4367-815e-77161bf077d7 req-b09f6cfb-72c4-4425-afe7-bfc687d4dbbd tempest-TestInstancesWithCinderVolumes-611890464 None] Deleting attachment 1fb2ca2f-e1e9-4ae5-b02d-9bf004a7061b. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:05:25 devstack sudo[120811]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb" returned: 0 in 1.354s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:25 devstack sudo[120907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb Jun 23 14:05:25 devstack sudo[120907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:26 devstack sudo[120907]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-aebc5783-cbb3-4ec9-8049-5d442af82beb" returned: 0 in 0.698s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-quobyte-aebc5783-cbb3-4ec9-8049-5d442af82beb" released by "delete_volume" :: held 2.141s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Created reservations ['179fb0bb-65fc-42d3-ab89-158477796225', '013237e8-8194-4520-a1c4-a7b23ff2b44a', '19dddc53-a7e8-4dde-8529-089fc1bd2ed2', 'deff89fc-3e3e-4421-84d0-767eb9de920c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:26 devstack sudo[120942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:26 devstack sudo[120942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "cinder-61d1ea12-a6e9-486f-b245-217798c56e01-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-61d1ea12-a6e9-486f-b245-217798c56e01-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "cinder-quobyte-61d1ea12-a6e9-486f-b245-217798c56e01" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-quobyte-61d1ea12-a6e9-486f-b245-217798c56e01" acquired by "delete_volume" :: waited 0.040s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf2b5a-54c8-404d-b545-36b57abf03f4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:27 devstack sudo[120956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 Jun 23 14:05:27 devstack sudo[120956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:27 devstack sudo[120942]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.953s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Deleted volume successfully. Jun 23 14:05:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dae3625b-9ecd-47a9-8c16-0a0be43df7d5 tempest-VolumesDeleteCascade-316106258 None] Lock "cinder-aebc5783-cbb3-4ec9-8049-5d442af82beb-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:28 devstack sudo[120956]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01" returned: 0 in 1.492s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:28 devstack sudo[121007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01 Jun 23 14:05:28 devstack sudo[121007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:30 devstack sudo[121007]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-61d1ea12-a6e9-486f-b245-217798c56e01" returned: 0 in 1.399s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-quobyte-61d1ea12-a6e9-486f-b245-217798c56e01" released by "delete_volume" :: held 2.984s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:30 devstack cinder-volume[93689]: WARNING cinder.quota [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-303532033-1255654591 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-303532033-1255654591, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:30 devstack cinder-volume[93689]: WARNING cinder.quota [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-303532033-1255654591 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-303532033-1255654591, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Created reservations ['3c4cc4e3-da3b-4208-b604-11d75c72d753', '7e1bbe38-e74d-4dd1-86e6-58422d5b8b6c', '102e1aac-83c2-4360-a4b1-ce2f58810ae0', '2a9c7890-9dc4-4f95-8e08-d168ddfbdc89'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:30 devstack sudo[121070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:30 devstack sudo[121070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc6712-39e5-41d2-94bb-be4769920136]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:30 devstack sudo[121075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c Jun 23 14:05:30 devstack sudo[121075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:31 devstack sudo[121070]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.509s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:31 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Deleted volume successfully. Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7186d683-b724-47d6-b689-991a72a272c2 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-61d1ea12-a6e9-486f-b245-217798c56e01-delete_volume" released by "delete_volume" :: held 5.023s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:32 devstack sudo[121075]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c" returned: 0 in 1.776s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.813s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-df44b24b-ab25-4151-8a37-273204785f8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e74fc687-3c5c-4654-97ea-c21ace1c3561', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:05:32 devstack sudo[121136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:32 devstack sudo[121136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-4da54b4e-42e9-466f-bc57-287ae9a64cee req-06cdb8be-023e-42f0-bf1d-77515103f998 tempest-AttachVolumeNegativeTest-1216548935 None] attachment_update completed successfully. Jun 23 14:05:34 devstack sudo[121136]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.829s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:34 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:34 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:05:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:05:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:05:35 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Flow 'volume_create_manager' (822ca074-00dd-4b47-9b15-0532d368b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54081d6c-d10f-4cdf-9390-0dd114a2b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54081d6c-d10f-4cdf-9390-0dd114a2b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978566135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0552217a-5128-4385-a563-9df362586d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0005d3637f41b7baf438ab6b7e6cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:36Z,use_quota=True,user_id='c7a365c536bd46d68519975623025031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf5f357-47b4-4ff2-9565-347878170402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf5f357-47b4-4ff2-9565-347878170402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0504b0e6-dab6-46b5-b9ee-782490e437a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0504b0e6-dab6-46b5-b9ee-782490e437a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0552217a-5128-4385-a563-9df362586d17', 'volume_name': 'volume-0552217a-5128-4385-a563-9df362586d17', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b87013a-8e35-44f9-8401-5167a285b4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b87013a-8e35-44f9-8401-5167a285b4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8603b7-fad5-4b0b-b9e8-e57a48c44ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Volume 0552217a-5128-4385-a563-9df362586d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0552217a-5128-4385-a563-9df362586d17', 'volume_size': 1} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978566135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0552217a-5128-4385-a563-9df362586d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0005d3637f41b7baf438ab6b7e6cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:36Z,use_quota=True,user_id='c7a365c536bd46d68519975623025031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Creating volume 0552217a-5128-4385-a563-9df362586d17 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:36 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:05:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:36 devstack sudo[121302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 1073741824 Jun 23 14:05:36 devstack sudo[121302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:37 devstack sudo[121302]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 1073741824" returned: 0 in 1.406s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:37 devstack sudo[121388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 Jun 23 14:05:37 devstack sudo[121388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-20624d47-7677-45c3-82a0-cdd3259db574 req-e15e0b87-516f-491c-89cc-2601ccadd429 tempest-TestInstancesWithCinderVolumes-611890464 None] Terminate volume connection completed successfully. Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-20624d47-7677-45c3-82a0-cdd3259db574 req-e15e0b87-516f-491c-89cc-2601ccadd429 tempest-TestInstancesWithCinderVolumes-611890464 None] Deleting attachment 880caaf2-19f4-4fc6-93d3-997e9d387058. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:05:38 devstack sudo[121388]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17" returned: 0 in 0.979s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] <== create_volume: return (2474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8603b7-fad5-4b0b-b9e8-e57a48c44ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0552217a-5128-4385-a563-9df362586d17', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ac76eb-d5a3-40db-abe9-83ac0e6a2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:38 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Volume volume-0552217a-5128-4385-a563-9df362586d17 (0552217a-5128-4385-a563-9df362586d17): created successfully Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ac76eb-d5a3-40db-abe9-83ac0e6a2d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Flow 'volume_create_manager' (822ca074-00dd-4b47-9b15-0532d368b24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-61d6a113-6eae-43d0-8db6-eee87b2486b8 tempest-VolumesMetadataTest-1282315717 None] Created volume successfully. Jun 23 14:05:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Acquiring lock "cinder-0552217a-5128-4385-a563-9df362586d17-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Lock "cinder-0552217a-5128-4385-a563-9df362586d17-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Acquiring lock "cinder-quobyte-0552217a-5128-4385-a563-9df362586d17" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Lock "cinder-quobyte-0552217a-5128-4385-a563-9df362586d17" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8afd43a-1a86-4233-8e4d-3ae7812d61f4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:40 devstack sudo[121476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 Jun 23 14:05:40 devstack sudo[121476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:40 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-852bebce-0ca5-48ec-882b-d53a07963067 req-7a74393b-df89-45ce-8977-a81b14dc4301 tempest-AttachVolumeNegativeTest-1216548935 None] Terminate volume connection completed successfully. Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-852bebce-0ca5-48ec-882b-d53a07963067 req-7a74393b-df89-45ce-8977-a81b14dc4301 tempest-AttachVolumeNegativeTest-1216548935 None] Deleting attachment e74fc687-3c5c-4654-97ea-c21ace1c3561. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:05:40 devstack sudo[121476]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17" returned: 0 in 0.807s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:40 devstack sudo[121507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17 Jun 23 14:05:40 devstack sudo[121507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:41 devstack sudo[121507]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0552217a-5128-4385-a563-9df362586d17" returned: 0 in 0.721s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Lock "cinder-quobyte-0552217a-5128-4385-a563-9df362586d17" released by "delete_volume" :: held 1.600s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Created reservations ['239eb9d2-fba7-4b71-8b67-0b56a60ecb53', 'd3f1a20b-0aee-4a67-8fb8-455d16d89362', '4d665556-856e-493d-a2b7-948b196abe6e', '19205755-1195-4451-bf54-a576512d47e4'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:41 devstack sudo[121537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:41 devstack sudo[121537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "cinder-d6bc88ff-546e-448b-a86a-1b1d1593077c-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-d6bc88ff-546e-448b-a86a-1b1d1593077c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "cinder-quobyte-d6bc88ff-546e-448b-a86a-1b1d1593077c" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-quobyte-d6bc88ff-546e-448b-a86a-1b1d1593077c" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:42 devstack sudo[121537]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.942s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Deleted volume successfully. Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dba3f90-5daa-4498-a685-843eecde1b73 tempest-VolumesMetadataTest-1282315717 None] Lock "cinder-0552217a-5128-4385-a563-9df362586d17-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[126eadde-777f-4af8-94ac-a3df50c2aec5]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:42 devstack sudo[121569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:05:42 devstack sudo[121569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:44 devstack sudo[121569]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 0 in 1.366s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:44 devstack sudo[121650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:05:44 devstack sudo[121650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:45 devstack sudo[121650]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 1 in 1.310s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:05:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:45 devstack sudo[121699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c Jun 23 14:05:45 devstack sudo[121699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:46 devstack sudo[121699]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-d6bc88ff-546e-448b-a86a-1b1d1593077c" returned: 0 in 1.108s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-quobyte-d6bc88ff-546e-448b-a86a-1b1d1593077c" released by "delete_volume" :: held 3.895s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:46 devstack cinder-volume[93689]: WARNING cinder.quota [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-778811847-1540113069 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-778811847-1540113069, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:46 devstack cinder-volume[93689]: WARNING cinder.quota [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-778811847-1540113069 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-778811847-1540113069, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Created reservations ['68cef83a-f076-428f-9393-41d7abbdd1f4', 'ef7dac8f-1aaa-495e-a147-81048b8de925', '28967a3f-b877-48b4-a0bb-83f6ceaad8cf', '93e27e96-0ff8-4dfb-800b-4563b8b4d236'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:46 devstack sudo[121744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:46 devstack sudo[121744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:47 devstack sudo[121744]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.729s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:47 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Deleted volume successfully. Jun 23 14:05:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2b2c486-1ed3-4d04-9a9e-980023cef000 tempest-TestInstancesWithCinderVolumes-611890464 None] Lock "cinder-d6bc88ff-546e-448b-a86a-1b1d1593077c-delete_volume" released by "delete_volume" :: held 4.959s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "cinder-df44b24b-ab25-4151-8a37-273204785f8c-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-df44b24b-ab25-4151-8a37-273204785f8c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "cinder-quobyte-df44b24b-ab25-4151-8a37-273204785f8c" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-quobyte-df44b24b-ab25-4151-8a37-273204785f8c" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca36ad2-973d-4a5a-bd26-12c73af0d4ea]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:54 devstack sudo[121971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c Jun 23 14:05:54 devstack sudo[121971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:55 devstack sudo[121971]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c" returned: 0 in 1.010s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:55 devstack sudo[122007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c Jun 23 14:05:55 devstack sudo[122007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:56 devstack sudo[122007]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-df44b24b-ab25-4151-8a37-273204785f8c" returned: 0 in 0.776s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-quobyte-df44b24b-ab25-4151-8a37-273204785f8c" released by "delete_volume" :: held 1.843s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Created reservations ['a2e8388b-c804-4123-a3d4-0daed16801ad', 'a6089281-6559-4122-8df9-1e069b1da598', '201947dc-a60c-481a-9aaa-574970665300', 'b10d23ff-0294-444b-8cac-3eccb0d7c79e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:56 devstack sudo[122040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:56 devstack sudo[122040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "cinder-50d96b4b-c241-482f-8fcb-49d6262472c4-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-50d96b4b-c241-482f-8fcb-49d6262472c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "cinder-quobyte-50d96b4b-c241-482f-8fcb-49d6262472c4" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-quobyte-50d96b4b-c241-482f-8fcb-49d6262472c4" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaca0be-a0a2-4ec1-b885-4e68e32e7cc1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:56 devstack sudo[122057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 Jun 23 14:05:56 devstack sudo[122057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:57 devstack sudo[122040]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.022s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:57 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Deleted volume successfully. Jun 23 14:05:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6ac0726d-856d-421e-8bf0-56a2bb00ce68 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-df44b24b-ab25-4151-8a37-273204785f8c-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:58 devstack sudo[122057]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4" returned: 0 in 1.329s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:58 devstack sudo[122102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4 Jun 23 14:05:58 devstack sudo[122102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Flow 'volume_create_manager' (17dbdb29-f9aa-46be-b1f9-e9c7e87ce4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43f1935-6024-4884-8595-9e00e79c3bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43f1935-6024-4884-8595-9e00e79c3bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455342559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883538de-6e74-403b-9816-00c91afcec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4194957d914499e9aebccc368f227b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:58Z,use_quota=True,user_id='6fe6e6169b8d407aaa981ea0c0a1f753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e163f1-28f6-431d-a6a0-d8bd1fd85eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e163f1-28f6-431d-a6a0-d8bd1fd85eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d05498c-e7c5-44bb-b7fa-11ad5ba4d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d05498c-e7c5-44bb-b7fa-11ad5ba4d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883538de-6e74-403b-9816-00c91afcec04', 'volume_name': 'volume-883538de-6e74-403b-9816-00c91afcec04', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95c10fc-a30b-4616-b049-4fb9b854ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95c10fc-a30b-4616-b049-4fb9b854ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c007c432-ad89-43bd-9c83-b338b8fb3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Volume 883538de-6e74-403b-9816-00c91afcec04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883538de-6e74-403b-9816-00c91afcec04', 'volume_size': 1} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455342559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883538de-6e74-403b-9816-00c91afcec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4194957d914499e9aebccc368f227b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:58Z,use_quota=True,user_id='6fe6e6169b8d407aaa981ea0c0a1f753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Creating volume 883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:58 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:58 devstack sudo[122113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 1073741824 Jun 23 14:05:58 devstack sudo[122113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:58 devstack sudo[122102]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-50d96b4b-c241-482f-8fcb-49d6262472c4" returned: 0 in 0.818s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-quobyte-50d96b4b-c241-482f-8fcb-49d6262472c4" released by "delete_volume" :: held 2.245s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Created reservations ['4f3b7351-a74a-440f-ade2-9cc2de3d2fb7', '9c737085-1674-4096-ac61-39969683cfa8', 'd94635b3-b845-4597-b127-180ae0c00501', 'd0b91a84-be36-4e1c-b48f-914479fe7743'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:59 devstack sudo[122144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:05:59 devstack sudo[122144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:59 devstack sudo[122113]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 1073741824" returned: 0 in 1.183s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "cinder-f4a51f4c-6208-4c34-838e-71ec760241a4-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:59 devstack sudo[122158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:05:59 devstack sudo[122158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-f4a51f4c-6208-4c34-838e-71ec760241a4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "cinder-quobyte-f4a51f4c-6208-4c34-838e-71ec760241a4" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-quobyte-f4a51f4c-6208-4c34-838e-71ec760241a4" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe1ee13-a50e-4d52-8fe8-a099f6537058]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:00 devstack sudo[122173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 Jun 23 14:06:00 devstack sudo[122173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:00 devstack sudo[122144]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.371s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:00 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Deleted volume successfully. Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0b912f0c-a5c1-4785-acef-64e25c788a71 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-50d96b4b-c241-482f-8fcb-49d6262472c4-delete_volume" released by "delete_volume" :: held 4.028s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:00 devstack sudo[122158]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 1.182s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] <== create_volume: return (2470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c007c432-ad89-43bd-9c83-b338b8fb3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883538de-6e74-403b-9816-00c91afcec04', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36fc4b7-0765-4e64-9b3c-7aa65109f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:00 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Volume volume-883538de-6e74-403b-9816-00c91afcec04 (883538de-6e74-403b-9816-00c91afcec04): created successfully Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36fc4b7-0765-4e64-9b3c-7aa65109f969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:00 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Flow 'volume_create_manager' (17dbdb29-f9aa-46be-b1f9-e9c7e87ce4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:00 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-863dd51a-4c64-48d1-9d36-85f8cb471986 tempest-VolumesActionsTest-108705956 None] Created volume successfully. Jun 23 14:06:01 devstack sudo[122173]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4" returned: 0 in 1.376s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:01 devstack sudo[122228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4 Jun 23 14:06:01 devstack sudo[122228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:02 devstack sudo[122228]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f4a51f4c-6208-4c34-838e-71ec760241a4" returned: 0 in 0.983s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-quobyte-f4a51f4c-6208-4c34-838e-71ec760241a4" released by "delete_volume" :: held 2.447s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Created reservations ['d7f58587-5657-4221-824e-aade6b388821', '0730249e-a5c4-48da-92ca-cc45e9e720f3', '77c5ad1a-a254-4ef2-8eab-20593b7cb9ed', '45819ec2-c4fc-4fe5-8ed5-892501079e9c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:02 devstack sudo[122291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:06:02 devstack sudo[122291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:03 devstack sudo[122291]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.054s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:03 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Deleted volume successfully. Jun 23 14:06:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-960c9ca9-812d-4517-9175-b8f3164375f2 tempest-AttachVolumeNegativeTest-1216548935 None] Lock "cinder-f4a51f4c-6208-4c34-838e-71ec760241a4-delete_volume" released by "delete_volume" :: held 4.020s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:08 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d631a2b7-d25c-4fee-910e-ade28f2f8ac5 req-a94964ec-0411-4d28-9381-9d649ed88120 tempest-TestShelveInstance-971418965 None] Terminate volume connection completed successfully. Jun 23 14:06:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-d631a2b7-d25c-4fee-910e-ade28f2f8ac5 req-a94964ec-0411-4d28-9381-9d649ed88120 tempest-TestShelveInstance-971418965 None] Deleting attachment ba1b28e9-44f4-42fc-96f8-0b0d73003c33. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Flow 'volume_create_manager' (318cdbb9-7459-4f08-82ca-e94030a6bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dda4fa-3037-436e-805e-bd9ea4913946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dda4fa-3037-436e-805e-bd9ea4913946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-853637056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38918cc3-e98c-40d3-ad70-fba38e3be0b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='abeebea5e31c4d018f2a03ed32994757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:14Z,use_quota=True,user_id='7829c38a91164b1eb254dc06851c3d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d21add-c6d6-4444-b69c-f82f4ec6c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d21add-c6d6-4444-b69c-f82f4ec6c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f68d376-d712-4331-a18b-c14c8355943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f68d376-d712-4331-a18b-c14c8355943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38918cc3-e98c-40d3-ad70-fba38e3be0b0', 'volume_name': 'volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0aced-3e54-46c0-bb3a-b56581735a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0aced-3e54-46c0-bb3a-b56581735a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7cb350-e3e9-4c03-8f67-da5253a9731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:14 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Volume 38918cc3-e98c-40d3-ad70-fba38e3be0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0', 'volume_size': 1} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-853637056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38918cc3-e98c-40d3-ad70-fba38e3be0b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='abeebea5e31c4d018f2a03ed32994757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:14Z,use_quota=True,user_id='7829c38a91164b1eb254dc06851c3d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Creating volume 38918cc3-e98c-40d3-ad70-fba38e3be0b0 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:14 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:06:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:14 devstack sudo[122708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 1073741824 Jun 23 14:06:14 devstack sudo[122708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:15 devstack sudo[122708]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 1073741824" returned: 0 in 1.058s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:15 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=77,cinder:UPDATE=82,cinder:DELETE=6,cinder:INSERT=23 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:06:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:15 devstack sudo[122753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 Jun 23 14:06:15 devstack sudo[122753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:16 devstack sudo[122753]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0" returned: 0 in 0.983s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.678s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=104,cinder:SELECT=71,cinder:INSERT=21,cinder:DELETE=7 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7cb350-e3e9-4c03-8f67-da5253a9731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c250d88c-1469-4a67-852f-e3167718b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d84d71-de19-4ecd-9d2a-b822283c7781]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:16 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Volume volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 (38918cc3-e98c-40d3-ad70-fba38e3be0b0): created successfully Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c250d88c-1469-4a67-852f-e3167718b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Flow 'volume_create_manager' (318cdbb9-7459-4f08-82ca-e94030a6bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f6b7b79e-7343-4653-b70c-8d5ff9ca0fbd tempest-VolumesTestJSON-856796326 None] Created volume successfully. Jun 23 14:06:17 devstack sudo[122805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:06:17 devstack sudo[122805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:18 devstack sudo[122805]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 1.827s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:18 devstack sudo[122929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:06:18 devstack sudo[122929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Flow 'volume_create_manager' (c930ba9d-e254-4dd7-97ef-bc146d35a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b732ea-e06e-4f22-a760-f3b87468e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b732ea-e06e-4f22-a760-f3b87468e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1933329387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4759a7-fd64-4d94-81c6-a01e1414d8cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='abeebea5e31c4d018f2a03ed32994757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:19Z,use_quota=True,user_id='7829c38a91164b1eb254dc06851c3d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1e5b21-a18a-403d-839d-e1a0a8ed68ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1e5b21-a18a-403d-839d-e1a0a8ed68ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72152db7-c19f-47d0-ac3d-75b6227160eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72152db7-c19f-47d0-ac3d-75b6227160eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4759a7-fd64-4d94-81c6-a01e1414d8cf', 'volume_name': 'volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5376ac0-2624-41e6-9295-c7dbd6cf4f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5376ac0-2624-41e6-9295-c7dbd6cf4f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de06e1b8-a380-4830-b7be-0c0dc1f14788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Volume fa4759a7-fd64-4d94-81c6-a01e1414d8cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf', 'volume_size': 1} Jun 23 14:06:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:20 devstack sudo[122929]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 1 in 1.805s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.728s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1933329387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4759a7-fd64-4d94-81c6-a01e1414d8cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='abeebea5e31c4d018f2a03ed32994757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:19Z,use_quota=True,user_id='7829c38a91164b1eb254dc06851c3d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Creating volume fa4759a7-fd64-4d94-81c6-a01e1414d8cf {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:20 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:20 devstack sudo[122991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf 1073741824 Jun 23 14:06:20 devstack sudo[122991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59d11b99-799f-412c-abc6-fe92e3300a85', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:06:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-cc1a232b-9b42-44f8-a1dc-2b33a8297898 req-bc0785a1-5b57-497b-895d-2d032291e0cb tempest-TestShelveInstance-971418965 None] attachment_update completed successfully. Jun 23 14:06:22 devstack sudo[122991]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf 1073741824" returned: 0 in 1.706s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:22 devstack sudo[123049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf Jun 23 14:06:22 devstack sudo[123049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7a8685d2-0df8-4b84-85d2-2fa0849964b9 tempest-VolumesActionsTest-108705956 None] Acquiring lock "cinder-883538de-6e74-403b-9816-00c91afcec04" by "attach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7a8685d2-0df8-4b84-85d2-2fa0849964b9 tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04" acquired by "attach_volume" :: waited 0.053s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7a8685d2-0df8-4b84-85d2-2fa0849964b9 tempest-VolumesActionsTest-108705956 None] Attaching volume 883538de-6e74-403b-9816-00c91afcec04 to instance d46c697a-9667-46b0-990c-1f7e2dd42d94 at mountpoint /dev/vdb on host None. Jun 23 14:06:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7a8685d2-0df8-4b84-85d2-2fa0849964b9 tempest-VolumesActionsTest-108705956 None] Attach volume completed successfully. Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7a8685d2-0df8-4b84-85d2-2fa0849964b9 tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04" released by "attach_volume" :: held 0.196s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:23 devstack sudo[123049]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf" returned: 0 in 1.143s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] <== create_volume: return (2925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.934s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de06e1b8-a380-4830-b7be-0c0dc1f14788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc431cac-9012-4b6a-b8b0-2b70c14e2721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Volume volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf (fa4759a7-fd64-4d94-81c6-a01e1414d8cf): created successfully Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc431cac-9012-4b6a-b8b0-2b70c14e2721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Flow 'volume_create_manager' (c930ba9d-e254-4dd7-97ef-bc146d35a28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5fdb216d-a656-45b5-876e-3972c9736375 tempest-VolumesTestJSON-856796326 None] Created volume successfully. Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd96765d-56d8-4879-a0a1-6ef8018e2f50 tempest-VolumesActionsTest-108705956 None] Acquiring lock "cinder-883538de-6e74-403b-9816-00c91afcec04-detach_volume" by "detach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd96765d-56d8-4879-a0a1-6ef8018e2f50 tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-dd96765d-56d8-4879-a0a1-6ef8018e2f50 tempest-VolumesActionsTest-108705956 None] Detaching volume 883538de-6e74-403b-9816-00c91afcec04 from instance d46c697a-9667-46b0-990c-1f7e2dd42d94. Jun 23 14:06:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-dd96765d-56d8-4879-a0a1-6ef8018e2f50 tempest-VolumesActionsTest-108705956 None] Detach volume completed successfully. Jun 23 14:06:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd96765d-56d8-4879-a0a1-6ef8018e2f50 tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Flow 'volume_create_manager' (c185c8b1-3bf6-4af6-bbf8-c1f0e2ae6c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82be463e-3b5e-4ea5-97db-3168f88c2e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82be463e-3b5e-4ea5-97db-3168f88c2e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-983939127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee1555e-a07b-4890-8d71-44be9f6f5929,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='abeebea5e31c4d018f2a03ed32994757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:25Z,use_quota=True,user_id='7829c38a91164b1eb254dc06851c3d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b5b297-1a01-4720-8664-b8644c29133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b5b297-1a01-4720-8664-b8644c29133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa005c3e-93c4-4091-85d0-80eb405cc0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa005c3e-93c4-4091-85d0-80eb405cc0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee1555e-a07b-4890-8d71-44be9f6f5929', 'volume_name': 'volume-0ee1555e-a07b-4890-8d71-44be9f6f5929', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1549e41-34c4-4f7f-8799-102fbf17ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1549e41-34c4-4f7f-8799-102fbf17ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470fe52f-ebd6-4049-a989-d027079515cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Volume 0ee1555e-a07b-4890-8d71-44be9f6f5929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee1555e-a07b-4890-8d71-44be9f6f5929', 'volume_size': 1} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-983939127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee1555e-a07b-4890-8d71-44be9f6f5929,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='abeebea5e31c4d018f2a03ed32994757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:25Z,use_quota=True,user_id='7829c38a91164b1eb254dc06851c3d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Creating volume 0ee1555e-a07b-4890-8d71-44be9f6f5929 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:25 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:06:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:25 devstack sudo[123149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 1073741824 Jun 23 14:06:25 devstack sudo[123149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:26 devstack sudo[123149]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 1073741824" returned: 0 in 1.321s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:26 devstack sudo[123230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 Jun 23 14:06:26 devstack sudo[123230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:27 devstack sudo[123230]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929" returned: 0 in 0.848s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470fe52f-ebd6-4049-a989-d027079515cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee1555e-a07b-4890-8d71-44be9f6f5929', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82db97e9-f9a5-459b-bca1-f55db8c052d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:27 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Volume volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 (0ee1555e-a07b-4890-8d71-44be9f6f5929): created successfully Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82db97e9-f9a5-459b-bca1-f55db8c052d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Flow 'volume_create_manager' (c185c8b1-3bf6-4af6-bbf8-c1f0e2ae6c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ae6ba3e9-740d-469c-9b7f-135df209ce22 tempest-VolumesTestJSON-856796326 None] Created volume successfully. Jun 23 14:06:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Acquiring lock "cinder-0ee1555e-a07b-4890-8d71-44be9f6f5929-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Lock "cinder-0ee1555e-a07b-4890-8d71-44be9f6f5929-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Acquiring lock "cinder-quobyte-0ee1555e-a07b-4890-8d71-44be9f6f5929" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Lock "cinder-quobyte-0ee1555e-a07b-4890-8d71-44be9f6f5929" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:30 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0cb0b-6f46-4940-99cd-444405e4682e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:31 devstack sudo[123355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 Jun 23 14:06:31 devstack sudo[123355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:31 devstack sudo[123355]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929" returned: 0 in 0.999s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:31 devstack sudo[123390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929 Jun 23 14:06:31 devstack sudo[123390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:32 devstack sudo[123455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:06:32 devstack sudo[123455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:33 devstack sudo[123390]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0ee1555e-a07b-4890-8d71-44be9f6f5929" returned: 0 in 1.218s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Lock "cinder-quobyte-0ee1555e-a07b-4890-8d71-44be9f6f5929" released by "delete_volume" :: held 2.309s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Created reservations ['80694909-ee2a-4c0e-9cd5-a33d563bd2ef', 'a74ae065-1e25-4716-9d49-85672ad8e1a7', '2bd85360-793b-4695-b36c-bfe97c70612c', 'c4ec9bda-cc67-4ba5-a72d-25a51e95e30f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:33 devstack sudo[123510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:06:33 devstack sudo[123510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.237s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:33 devstack sudo[123455]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:06:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Acquiring lock "cinder-fa4759a7-fd64-4d94-81c6-a01e1414d8cf-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Lock "cinder-fa4759a7-fd64-4d94-81c6-a01e1414d8cf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Acquiring lock "cinder-quobyte-fa4759a7-fd64-4d94-81c6-a01e1414d8cf" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Lock "cinder-quobyte-fa4759a7-fd64-4d94-81c6-a01e1414d8cf" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c26e57-afd9-433c-84e0-c46a0f8a409e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:34 devstack sudo[123510]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.053s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:34 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Deleted volume successfully. Jun 23 14:06:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b15ca359-806e-4f64-b8b1-55c076159230 tempest-VolumesTestJSON-856796326 None] Lock "cinder-0ee1555e-a07b-4890-8d71-44be9f6f5929-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:34 devstack sudo[123548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf Jun 23 14:06:34 devstack sudo[123548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:35 devstack sudo[123548]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf" returned: 0 in 1.272s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:35 devstack sudo[123913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf Jun 23 14:06:35 devstack sudo[123913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:36 devstack sudo[123913]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa4759a7-fd64-4d94-81c6-a01e1414d8cf" returned: 0 in 0.984s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Lock "cinder-quobyte-fa4759a7-fd64-4d94-81c6-a01e1414d8cf" released by "delete_volume" :: held 2.359s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:36 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Created reservations ['cd3024c8-7551-4af1-b09c-fec3130b11d9', '47da9dae-5b7b-4376-9862-a371719bcd2c', '47943d69-8d76-499f-9e2b-ab425155c6e7', '66325208-2663-495c-8111-d2b6da21afe2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:37 devstack sudo[123998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:06:37 devstack sudo[123998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Acquiring lock "cinder-38918cc3-e98c-40d3-ad70-fba38e3be0b0-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Lock "cinder-38918cc3-e98c-40d3-ad70-fba38e3be0b0-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Acquiring lock "cinder-quobyte-38918cc3-e98c-40d3-ad70-fba38e3be0b0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Lock "cinder-quobyte-38918cc3-e98c-40d3-ad70-fba38e3be0b0" acquired by "delete_volume" :: waited 0.050s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60770c-9f74-493d-bb1e-df4441f181a3]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:38 devstack sudo[123998]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.432s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Deleted volume successfully. Jun 23 14:06:38 devstack sudo[124103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 Jun 23 14:06:38 devstack sudo[124103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1dcd0a80-f587-488c-8d8a-01ab474b4801 tempest-VolumesTestJSON-856796326 None] Lock "cinder-fa4759a7-fd64-4d94-81c6-a01e1414d8cf-delete_volume" released by "delete_volume" :: held 4.347s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:39 devstack sudo[124103]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0" returned: 0 in 1.445s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:39 devstack sudo[124155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0 Jun 23 14:06:39 devstack sudo[124155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:40 devstack sudo[124155]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-38918cc3-e98c-40d3-ad70-fba38e3be0b0" returned: 0 in 1.153s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Lock "cinder-quobyte-38918cc3-e98c-40d3-ad70-fba38e3be0b0" released by "delete_volume" :: held 2.698s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Created reservations ['e9ce6248-2d24-4de0-b6f4-1ac7ca4eb281', 'cc3c7701-d15c-4f1a-98e3-101567b0c791', '64855310-906f-4e23-bd23-0789b5bbff02', 'df555881-7bef-457b-b44b-18a38bbe7fc9'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:41 devstack sudo[124203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:06:41 devstack sudo[124203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:42 devstack sudo[124203]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.349s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:42 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Deleted volume successfully. Jun 23 14:06:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-f9579bde-c909-48b4-b8a9-1ac99e5e7e35 tempest-VolumesTestJSON-856796326 None] Lock "cinder-38918cc3-e98c-40d3-ad70-fba38e3be0b0-delete_volume" released by "delete_volume" :: held 4.628s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a25c82bb-3bec-4c9d-9552-7598c4e210d6 tempest-GroupSnapshotsTest-598976176 None] Group tempest-GroupSnapshotsTest-Group-354166182: creating Jun 23 14:06:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a25c82bb-3bec-4c9d-9552-7598c4e210d6 tempest-GroupSnapshotsTest-598976176 None] Group tempest-GroupSnapshotsTest-Group-354166182: created successfully Jun 23 14:06:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a25c82bb-3bec-4c9d-9552-7598c4e210d6 tempest-GroupSnapshotsTest-598976176 None] Create group completed successfully. Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (d40fec71-ad4d-43a9-b786-8a86d1b623d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1624724-5290-4348-947f-ea036d8caf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1624724-5290-4348-947f-ea036d8caf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78458072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7aff1f6-b0cc-4979-b616-01cd8f6db698,host='devstack@QuobyteHD#QuobyteHD',id=2ba1ba0c-9cde-4914-b686-4f4ea861a457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:51Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bfb87d0-7de2-448a-96d9-3212febd4737),volume_type_id=5bfb87d0-7de2-448a-96d9-3212febd4737)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442d905a-1384-4b58-a116-b20beabb44cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442d905a-1384-4b58-a116-b20beabb44cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112d6e6c-7977-40b4-8081-d2a9e3f1ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112d6e6c-7977-40b4-8081-d2a9e3f1ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba1ba0c-9cde-4914-b686-4f4ea861a457', 'volume_name': 'volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6395d69-c3c8-4aa8-9d9b-622451bb048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6395d69-c3c8-4aa8-9d9b-622451bb048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63bf1ce-b2b4-4d91-8247-41030e604026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:50 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Volume 2ba1ba0c-9cde-4914-b686-4f4ea861a457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457', 'volume_size': 1} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7aff1f6-b0cc-4979-b616-01cd8f6db698,created_at=2026-06-23T12:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78458072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7aff1f6-b0cc-4979-b616-01cd8f6db698,host='devstack@QuobyteHD#QuobyteHD',id=2ba1ba0c-9cde-4914-b686-4f4ea861a457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:51Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bfb87d0-7de2-448a-96d9-3212febd4737),volume_type_id=5bfb87d0-7de2-448a-96d9-3212febd4737)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Creating volume 2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:51 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:06:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:51 devstack sudo[124536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 1073741824 Jun 23 14:06:51 devstack sudo[124536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:53 devstack sudo[124536]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 1073741824" returned: 0 in 2.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:54 devstack sudo[124734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:06:54 devstack sudo[124734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:55 devstack sudo[124734]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 1.210s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] <== create_volume: return (4160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.163s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63bf1ce-b2b4-4d91-8247-41030e604026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc99ca8-85d2-49f7-a65e-2e41021f57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Volume volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 (2ba1ba0c-9cde-4914-b686-4f4ea861a457): created successfully Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc99ca8-85d2-49f7-a65e-2e41021f57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (d40fec71-ad4d-43a9-b786-8a86d1b623d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d61cb8c1-c93c-430b-bd62-664df9a7b02a tempest-GroupSnapshotsTest-598976176 None] Created volume successfully. Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a01c5acd-9bc6-4262-bc52-51e7333a602a tempest-VolumesActionsTest-108705956 None] Acquiring lock "cinder-883538de-6e74-403b-9816-00c91afcec04" by "attach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a01c5acd-9bc6-4262-bc52-51e7333a602a tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04" acquired by "attach_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] GroupSnapshot 540fe9c1-1c98-4709-ac20-5c1328672e93: creating. Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Group snapshot 540fe9c1-1c98-4709-ac20-5c1328672e93: creating. {{(pid=93689) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a01c5acd-9bc6-4262-bc52-51e7333a602a tempest-VolumesActionsTest-108705956 None] Attaching volume 883538de-6e74-403b-9816-00c91afcec04 to instance 2090f5df-2333-4de0-9f13-bbe1b178334a at mountpoint /dev/vdb on host None. Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Creating offline snapshot ef56e73b-90eb-4e75-83e4-fc1e6c39290b of volume 2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b15a40e-6ccb-4c5b-8a09-ad6a4409dacb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a01c5acd-9bc6-4262-bc52-51e7333a602a tempest-VolumesActionsTest-108705956 None] Attach volume completed successfully. Jun 23 14:06:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a01c5acd-9bc6-4262-bc52-51e7333a602a tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04" released by "attach_volume" :: held 0.184s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:57 devstack sudo[124857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:06:57 devstack sudo[124857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ef9c0d0-83f7-480c-93c5-065e436b715a tempest-VolumesActionsTest-108705956 None] Acquiring lock "cinder-883538de-6e74-403b-9816-00c91afcec04-detach_volume" by "detach_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ef9c0d0-83f7-480c-93c5-065e436b715a tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0ef9c0d0-83f7-480c-93c5-065e436b715a tempest-VolumesActionsTest-108705956 None] Detaching volume 883538de-6e74-403b-9816-00c91afcec04 from instance 2090f5df-2333-4de0-9f13-bbe1b178334a. Jun 23 14:06:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0ef9c0d0-83f7-480c-93c5-065e436b715a tempest-VolumesActionsTest-108705956 None] Detach volume completed successfully. Jun 23 14:06:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ef9c0d0-83f7-480c-93c5-065e436b715a tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:58 devstack sudo[124857]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 0.892s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:58 devstack sudo[124890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b 1G Jun 23 14:06:58 devstack sudo[124890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:59 devstack sudo[124890]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b 1G" returned: 0 in 1.041s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:59 devstack sudo[124925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b Jun 23 14:06:59 devstack sudo[124925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:00 devstack sudo[124925]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b" returned: 0 in 0.888s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:00 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:07:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:00 devstack sudo[125013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b Jun 23 14:07:00 devstack sudo[125013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:01 devstack sudo[125013]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b" returned: 0 in 0.799s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:01 devstack sudo[125045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info Jun 23 14:07:01 devstack sudo[125045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:01 devstack sudo[125045]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info" returned: 0 in 0.733s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:01 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:07:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:01 devstack sudo[125084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info Jun 23 14:07:01 devstack sudo[125084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:02 devstack sudo[125084]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.info" returned: 0 in 1.117s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.584s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e5a0e325-cf7d-45b8-9d63-15d582f44661 tempest-GroupSnapshotsTest-598976176 None] group_snapshot 540fe9c1-1c98-4709-ac20-5c1328672e93: created successfully Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-ef56e73b-90eb-4e75-83e4-fc1e6c39290b-fa6d1f21-4b27-494c-96fa-4dec6917924c" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-ef56e73b-90eb-4e75-83e4-fc1e6c39290b-fa6d1f21-4b27-494c-96fa-4dec6917924c" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Creating volume fa6d1f21-4b27-494c-96fa-4dec6917924c from snapshot ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-fa6d1f21-4b27-494c-96fa-4dec6917924c" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-fa6d1f21-4b27-494c-96fa-4dec6917924c" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] snapshot: ef56e73b-90eb-4e75-83e4-fc1e6c39290b, volume: fa6d1f21-4b27-494c-96fa-4dec6917924c, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc6a79-4e2a-40ba-9084-0b98450ac8d9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:05 devstack sudo[125269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b Jun 23 14:07:05 devstack sudo[125269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:06 devstack sudo[125269]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b" returned: 0 in 1.121s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:07:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:07:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[32126aa2-a6c6-453f-8476-cb9cad1582d4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:06 devstack sudo[125310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:07:06 devstack sudo[125310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:07 devstack sudo[125310]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 1.285s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:07 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:07:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:07 devstack sudo[125353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c Jun 23 14:07:07 devstack sudo[125353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:13 devstack sudo[125353]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c" returned: 0 in 6.159s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:13 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5709c4c0-a1d6-4bf2-8f84-da4b0884970d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:14 devstack sudo[125551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:07:14 devstack sudo[125551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:14 devstack sudo[125551]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 0.941s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:14 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:07:14 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Converted 1024.00 MB image at 166.25 MB/s Jun 23 14:07:14 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:07:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:14 devstack sudo[125587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c Jun 23 14:07:14 devstack sudo[125587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=56,cinder:UPDATE=49,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:07:15 devstack sudo[125587]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c" returned: 0 in 0.654s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-fa6d1f21-4b27-494c-96fa-4dec6917924c" released by "_copy_volume_from_snapshot" :: held 10.320s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-ef56e73b-90eb-4e75-83e4-fc1e6c39290b-fa6d1f21-4b27-494c-96fa-4dec6917924c" released by "_create_volume_from_snapshot" :: held 10.402s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.462s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.328s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b05021-86fc-4922-ba25-a38dff3c1321]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-21939b00-cb5c-47bd-94d8-e97bc8110118 tempest-GroupSnapshotsTest-598976176 None] Create group from source-snapshot-540fe9c1-1c98-4709-ac20-5c1328672e93 completed successfully. Jun 23 14:07:15 devstack sudo[125611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:07:15 devstack sudo[125611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:16 devstack sudo[125611]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.844s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1267d4-8faf-48db-820e-42104d121d34]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:16 devstack sudo[125640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:07:16 devstack sudo[125640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-fa6d1f21-4b27-494c-96fa-4dec6917924c" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-fa6d1f21-4b27-494c-96fa-4dec6917924c" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f0ab50-b337-4bfe-93ec-c21e7e8c7f8b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:17 devstack sudo[125657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c Jun 23 14:07:17 devstack sudo[125657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:17 devstack sudo[125640]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.861s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.4ea35a4d-49f4-414b-a791-d6277ce16063b7pdz8d0.img {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:17 devstack sudo[125674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.4ea35a4d-49f4-414b-a791-d6277ce16063b7pdz8d0.img Jun 23 14:07:17 devstack sudo[125674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:17 devstack sudo[125657]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c" returned: 0 in 0.931s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:17 devstack sudo[125711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c Jun 23 14:07:17 devstack sudo[125711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:19 devstack sudo[125711]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fa6d1f21-4b27-494c-96fa-4dec6917924c" returned: 0 in 1.266s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-fa6d1f21-4b27-494c-96fa-4dec6917924c" released by "delete_volume" :: held 2.283s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:19 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:DELETE=5,cinder:UPDATE=46,cinder:SELECT=46,cinder:INSERT=12 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:07:19 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Created reservations ['ee4f646b-7ecb-493a-bb30-c276a7c0252d'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:19 devstack cinder-volume[93689]: WARNING cinder.quota [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1807256282 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1807256282, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:07:19 devstack cinder-volume[93689]: WARNING cinder.quota [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1807256282 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1807256282, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:07:19 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Created reservations ['809b7864-fca6-46e1-b38b-24f90ddc90b0', '44818f9b-71e6-4957-8e31-cef17df5d669', '75b599ea-797e-4256-b9e6-49d216b21612', 'b82646c6-2708-40e5-86d9-ccb5f5d9009d'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:20 devstack sudo[125794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:07:20 devstack sudo[125794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:21 devstack sudo[125794]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.174s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3ade55ac-b838-476f-885d-3b7d91fedd3f tempest-GroupSnapshotsTest-598976176 None] Delete group completed successfully. Jun 23 14:07:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] group_snapshot 540fe9c1-1c98-4709-ac20-5c1328672e93: deleting Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] group_snapshot 540fe9c1-1c98-4709-ac20-5c1328672e93: deleting {{(pid=93689) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-2ba1ba0c-9cde-4914-b686-4f4ea861a457" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2ba1ba0c-9cde-4914-b686-4f4ea861a457" acquired by "delete_snapshot" :: waited 0.069s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-ef56e73b-90eb-4e75-83e4-fc1e6c39290b" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-ef56e73b-90eb-4e75-83e4-fc1e6c39290b" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Deleting offline snapshot ef56e73b-90eb-4e75-83e4-fc1e6c39290b of volume 2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] snapshot_file for this snap is: volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3cf1c4-1aa2-4a2e-a6d2-b5bf7b11ddf1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:22 devstack sudo[125852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b Jun 23 14:07:22 devstack sudo[125852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:24 devstack sudo[125852]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b" returned: 0 in 2.557s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:24 devstack sudo[125674]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.4ea35a4d-49f4-414b-a791-d6277ce16063b7pdz8d0.img" returned: 0 in 7.102s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a52dfb-5ce6-4557-800f-e1025d0a87ab]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f668899-a838-4c0f-bb13-e311a9c2ac22]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:24 devstack sudo[125971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:07:24 devstack sudo[125971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:24 devstack sudo[125972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:07:24 devstack sudo[125972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:25 devstack sudo[125971]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 0.834s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:25 devstack sudo[126007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b Jun 23 14:07:25 devstack sudo[126007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:25 devstack sudo[125972]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 1.091s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:25 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.4ea35a4d-49f4-414b-a791-d6277ce16063b7pdz8d0.img {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:07:25 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Converted 1024.00 MB image at 144.15 MB/s Jun 23 14:07:25 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] 4ea35a4d-49f4-414b-a791-d6277ce16063 was raw, no need to convert to raw {{(pid=93689) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 14:07:26 devstack sudo[126007]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b" returned: 0 in 0.889s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:26 devstack sudo[126041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b Jun 23 14:07:26 devstack sudo[126041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-83f9166d-6be5-48cb-bfa6-aa9de5b30641 tempest-TestShelveInstance-971418965 None] Terminate volume connection completed successfully. Jun 23 14:07:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-83f9166d-6be5-48cb-bfa6-aa9de5b30641 tempest-TestShelveInstance-971418965 None] Deleting attachment 59d11b99-799f-412c-abc6-fe92e3300a85. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:07:26 devstack sudo[126041]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457.ef56e73b-90eb-4e75-83e4-fc1e6c39290b" returned: 0 in 0.752s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-ef56e73b-90eb-4e75-83e4-fc1e6c39290b" released by "_delete_snapshot" :: held 5.264s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2ba1ba0c-9cde-4914-b686-4f4ea861a457" released by "delete_snapshot" :: held 5.325s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:27 devstack cinder-volume[93689]: WARNING cinder.quota [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1807256282 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1807256282, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] Created reservations ['b6b73ba5-d556-4725-9851-e7f487596dd9', '32b47f69-a246-4d86-bc5a-04e4dbae2924', '73a21c96-3aab-444a-ba30-bc20fee581ef', '86dbbf1c-70c4-49f0-8beb-7973f2f9fd33'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-97820fc7-06ee-4034-adeb-a91d868a5465 tempest-GroupSnapshotsTest-598976176 None] group_snapshot 540fe9c1-1c98-4709-ac20-5c1328672e93: deleted successfully Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Acquiring lock "cinder-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Lock "cinder-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Acquiring lock "cinder-quobyte-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Lock "cinder-quobyte-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a505dc-c7b6-4d7b-84f4-ae5bf5919e30]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:27 devstack sudo[126085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:07:27 devstack sudo[126085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-2ba1ba0c-9cde-4914-b686-4f4ea861a457" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2ba1ba0c-9cde-4914-b686-4f4ea861a457" acquired by "delete_volume" :: waited 0.075s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:28 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[838cf6e0-3111-4621-ba21-46980e866ff3]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:28 devstack sudo[126108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:07:28 devstack sudo[126108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:28 devstack sudo[126085]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 1.296s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:29 devstack sudo[126130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:07:29 devstack sudo[126130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:29 devstack sudo[126108]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 1.341s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:29 devstack sudo[126160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457 Jun 23 14:07:29 devstack sudo[126160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Flow 'volume_create_manager' (608f2f94-98d6-43a5-b45d-2ae54c04ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05ef92b-b2a0-4ddd-a3fe-9f66bb3ebf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05ef92b-b2a0-4ddd-a3fe-9f66bb3ebf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-13188919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cf19ac54e14158853bc8e504559394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:30Z,use_quota=True,user_id='b781246f82794b278a91becffb5f8fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc91936-839d-4803-b0fc-73cb13a990ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc91936-839d-4803-b0fc-73cb13a990ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103541e6-9eed-4b50-99f3-627020aebeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103541e6-9eed-4b50-99f3-627020aebeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc', 'volume_name': 'volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1308dc-8e39-40e9-840a-70fe296a2736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1308dc-8e39-40e9-840a-70fe296a2736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99800f57-1893-45e1-90e6-1e8e6eab87ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Volume bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc', 'volume_size': 1} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:30 devstack sudo[126130]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 1 in 1.384s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:30 devstack sudo[126182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82 Jun 23 14:07:30 devstack sudo[126182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:30 devstack sudo[126160]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2ba1ba0c-9cde-4914-b686-4f4ea861a457" returned: 0 in 1.006s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2ba1ba0c-9cde-4914-b686-4f4ea861a457" released by "delete_volume" :: held 2.638s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Created reservations ['daadcf73-60fa-4fb7-a6ec-f8a7a7a5e260'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:30 devstack cinder-volume[93689]: WARNING cinder.db.api [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1807256282'] Jun 23 14:07:30 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Created reservations ['5cb0fae1-3470-432a-bd4e-79c3854730a7', 'ecabf7db-2db1-48a7-9637-2fdf488b46b3', 'ce6c70e4-f531-4429-afd9-fd7d33276e8d', '118f817a-6e7b-47ea-9bbd-c4fe9268de6d'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:31 devstack sudo[126182]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" returned: 0 in 1.087s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Lock "cinder-quobyte-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82" released by "delete_volume" :: held 3.919s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG cinder.quota [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Created reservations ['f7a34573-5d90-4f39-9d2c-65b86886b197', '67f89fda-8454-4400-87d9-c231e8de0630', '4127b3d4-b7b9-43a9-87a3-35eb21dfee5b', 'c91bc300-22e4-47c2-a09e-e45a9be5f39c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:31 devstack sudo[126223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:07:31 devstack sudo[126223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:31 devstack sudo[126231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:07:31 devstack sudo[126231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:32 devstack sudo[126254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:07:32 devstack sudo[126254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:32 devstack sudo[126223]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.184s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d2b65ecf-5f7d-4e5c-a66e-d9007bed4017 tempest-GroupSnapshotsTest-598976176 None] Delete group completed successfully. Jun 23 14:07:32 devstack sudo[126231]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.152s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG cinder.manager [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Deleted volume successfully. Jun 23 14:07:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [req-3d7e4034-bca7-406c-a189-b80dbeada137 req-222a3197-5ccf-47cc-91eb-0f420c999122 tempest-TestShelveInstance-971418965 None] Lock "cinder-0da9f7ab-6627-4bf1-b1f9-63a8f853ad82-delete_volume" released by "delete_volume" :: held 5.580s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cdc88aa0-6110-447c-8165-717571b0b44c tempest-GroupSnapshotsTest-598976176 None] Group tempest-GroupSnapshotsTest-Group-1943044514: creating Jun 23 14:07:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cdc88aa0-6110-447c-8165-717571b0b44c tempest-GroupSnapshotsTest-598976176 None] Group tempest-GroupSnapshotsTest-Group-1943044514: created successfully Jun 23 14:07:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cdc88aa0-6110-447c-8165-717571b0b44c tempest-GroupSnapshotsTest-598976176 None] Create group completed successfully. Jun 23 14:07:33 devstack sudo[126254]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.046s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:07:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:07:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (1c9b2cba-b1de-4a7a-9017-f727da416c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e02916-66ac-4db5-a33e-7bf394f31ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e02916-66ac-4db5-a33e-7bf394f31ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794493654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=652a536d-be25-4d52-b18f-a99cbd9138a8,host='devstack@QuobyteHD#QuobyteHD',id=2c35b007-be75-4b56-ab3a-ca3d8bf93a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:35Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f727d8ed-c692-490b-85b4-a97e19842077),volume_type_id=f727d8ed-c692-490b-85b4-a97e19842077)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c54ec5c-c39d-4a59-a722-8f6da5b2cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c54ec5c-c39d-4a59-a722-8f6da5b2cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d7afd2-bde6-45e3-ad56-8ba84673fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d7afd2-bde6-45e3-ad56-8ba84673fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c35b007-be75-4b56-ab3a-ca3d8bf93a35', 'volume_name': 'volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8210e5fd-3da2-4291-9ffc-0be3413af075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8210e5fd-3da2-4291-9ffc-0be3413af075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14f680d-9af6-4c36-912c-6f29bd0c6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:35 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Volume 2c35b007-be75-4b56-ab3a-ca3d8bf93a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35', 'volume_size': 1} Jun 23 14:07:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:45 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:INSERT=9,cinder:SELECT=33,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:07:45 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=38,cinder:UPDATE=39,cinder:INSERT=9 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (07556920-c19e-422d-b90d-1e8aab6b6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6accb1a5-fb54-4771-8fa4-690e04e030bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6accb1a5-fb54-4771-8fa4-690e04e030bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1384377957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ed49ed-f6ed-45a3-a0a2-e1787eae19e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:46Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f1ddd3-a71e-4b8f-9a27-01a44ed354a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f1ddd3-a71e-4b8f-9a27-01a44ed354a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f35384-523c-4ad3-b62d-92c894444dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f35384-523c-4ad3-b62d-92c894444dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ed49ed-f6ed-45a3-a0a2-e1787eae19e0', 'volume_name': 'volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce61ddb8-8cdb-40d2-b1ec-269158a82eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce61ddb8-8cdb-40d2-b1ec-269158a82eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb9599f-ae36-4ae1-9566-ee3956feb369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume 31ed49ed-f6ed-45a3-a0a2-e1787eae19e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0', 'volume_size': 1} Jun 23 14:07:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.200s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Uploaded volume to glance image-id: 4ea35a4d-49f4-414b-a791-d6277ce16063. {{(pid=93689) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.784s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-13188919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7cf19ac54e14158853bc8e504559394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:30Z,use_quota=True,user_id='b781246f82794b278a91becffb5f8fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Creating volume bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:49 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:07:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:49 devstack sudo[126833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc 1073741824 Jun 23 14:07:49 devstack sudo[126833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:49 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-00c90305-4a7b-4cfa-806f-084e7a4d0c1c tempest-VolumesActionsTest-108705956 None] Copy volume to image completed successfully. Jun 23 14:07:50 devstack sudo[126833]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc 1073741824" returned: 0 in 0.899s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:50 devstack sudo[126866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc Jun 23 14:07:50 devstack sudo[126866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:51 devstack sudo[126866]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" returned: 0 in 0.678s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.095s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=652a536d-be25-4d52-b18f-a99cbd9138a8,created_at=2026-06-23T12:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794493654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=652a536d-be25-4d52-b18f-a99cbd9138a8,host='devstack@QuobyteHD#QuobyteHD',id=2c35b007-be75-4b56-ab3a-ca3d8bf93a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:35Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f727d8ed-c692-490b-85b4-a97e19842077),volume_type_id=f727d8ed-c692-490b-85b4-a97e19842077)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Creating volume 2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:51 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99800f57-1893-45e1-90e6-1e8e6eab87ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4113d3b-3c4c-4a0f-a553-b3ea167201be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:51 devstack sudo[126890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 1073741824 Jun 23 14:07:51 devstack sudo[126890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:51 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Volume volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc (bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc): created successfully Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4113d3b-3c4c-4a0f-a553-b3ea167201be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Flow 'volume_create_manager' (608f2f94-98d6-43a5-b45d-2ae54c04ceab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-09843538-df85-4a70-a574-f1e9b0c04735 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Created volume successfully. Jun 23 14:07:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:52 devstack sudo[126890]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 1073741824" returned: 0 in 0.936s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:52 devstack sudo[126929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 Jun 23 14:07:52 devstack sudo[126929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:53 devstack sudo[126929]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" returned: 0 in 0.705s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.724s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1384377957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ed49ed-f6ed-45a3-a0a2-e1787eae19e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:46Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating volume 31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:53 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14f680d-9af6-4c36-912c-6f29bd0c6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:53 devstack sudo[126953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 1073741824 Jun 23 14:07:53 devstack sudo[126953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c28977-69b9-4127-85e5-cc86029c4353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:53 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Volume volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 (2c35b007-be75-4b56-ab3a-ca3d8bf93a35): created successfully Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c28977-69b9-4127-85e5-cc86029c4353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (1c9b2cba-b1de-4a7a-9017-f727da416c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-fc0660b0-d9e0-43b1-915f-db40c37c0789 tempest-GroupSnapshotsTest-598976176 None] Created volume successfully. Jun 23 14:07:54 devstack sudo[126953]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 1073741824" returned: 0 in 0.923s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:54 devstack sudo[126986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 Jun 23 14:07:54 devstack sudo[126986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:54 devstack sudo[126986]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" returned: 0 in 0.784s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.095s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51eadbf-0b6e-4b78-b83b-5186a357352c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb9599f-ae36-4ae1-9566-ee3956feb369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae77a5df-1242-4db2-a8dc-69c66f39a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 (31ed49ed-f6ed-45a3-a0a2-e1787eae19e0): created successfully Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae77a5df-1242-4db2-a8dc-69c66f39a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (07556920-c19e-422d-b90d-1e8aab6b6051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-58ea60c4-15d0-44d3-91b3-eed482c794d2 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created volume successfully. Jun 23 14:07:55 devstack sudo[127014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:07:55 devstack sudo[127014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (c44545b2-4739-46c2-9e83-453ceab4908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604d9821-31f0-40eb-a950-1dac4dc43734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604d9821-31f0-40eb-a950-1dac4dc43734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650852750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=652a536d-be25-4d52-b18f-a99cbd9138a8,host='devstack@QuobyteHD#QuobyteHD',id=27005b4d-ac3a-4a8f-b79b-06db5b22e52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:55Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f727d8ed-c692-490b-85b4-a97e19842077),volume_type_id=f727d8ed-c692-490b-85b4-a97e19842077)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94812805-c332-46b0-b0d3-762696811607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94812805-c332-46b0-b0d3-762696811607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6469fa-b5f0-442b-b5a3-ed5585331fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6469fa-b5f0-442b-b5a3-ed5585331fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27005b4d-ac3a-4a8f-b79b-06db5b22e52c', 'volume_name': 'volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d36d00-7649-4bea-aa6f-b4b6c7754797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d36d00-7649-4bea-aa6f-b4b6c7754797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488a6ada-0fc6-4ec5-bc9d-c2489387576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Volume 27005b4d-ac3a-4a8f-b79b-06db5b22e52c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c', 'volume_size': 1} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:55 devstack sudo[127014]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6152f42f-dc2d-4d47-8d3e-c0e79a032a95]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:55 devstack sudo[127054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:07:55 devstack sudo[127054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:56 devstack sudo[127054]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.837s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:56 devstack sudo[127083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img Jun 23 14:07:56 devstack sudo[127083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:01 devstack sudo[127083]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img" returned: 0 in 4.588s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:01 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01f87e-adfd-4ef1-8f67-8ccc3629d139]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:01 devstack sudo[127234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:08:01 devstack sudo[127234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:02 devstack sudo[127234]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.965s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:02 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04, size 1024.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:08:02 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Converted 1024.00 MB image at 223.12 MB/s Jun 23 14:08:02 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] 7b5334ce-ec51-4019-add2-4294a31f561e was raw, converting to qcow2 {{(pid=93689) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 14:08:02 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f3e136-3a36-40bf-94e9-32d1a8096f3f]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:02 devstack sudo[127269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img Jun 23 14:08:02 devstack sudo[127269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:03 devstack sudo[127269]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img" returned: 0 in 0.893s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:03 devstack sudo[127300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img Jun 23 14:08:03 devstack sudo[127300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:03 devstack sudo[127300]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img" returned: 1 in 0.775s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:08:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:03 devstack sudo[127328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z Jun 23 14:08:03 devstack sudo[127328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:04 devstack sudo[127328]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z" returned: 0 in 0.687s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:04 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Image conversion details: src /opt/stack/data/cinder/conversion/883538de-6e74-403b-9816-00c91afcec04.temp_image.7b5334ce-ec51-4019-add2-4294a31f561ebpen5tky.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:08:04 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 14:08:04 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa8764-8787-4745-bdf3-b1c698db5113]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:04 devstack sudo[127352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z Jun 23 14:08:04 devstack sudo[127352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:05 devstack sudo[127352]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hh5gwe5z" returned: 0 in 0.745s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.946s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Uploaded volume to glance image-id: 7b5334ce-ec51-4019-add2-4294a31f561e. {{(pid=93689) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 14:08:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.657s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c25b7b-d612-4a6e-a360-34f3e662bc95]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:06 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f61f0613-6c64-4e6e-9357-59cf4ef16fcb tempest-VolumesActionsTest-108705956 None] Copy volume to image completed successfully. Jun 23 14:08:06 devstack sudo[127433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc Jun 23 14:08:07 devstack sudo[127433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:07 devstack sudo[127433]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" returned: 0 in 0.849s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.335s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=652a536d-be25-4d52-b18f-a99cbd9138a8,created_at=2026-06-23T12:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650852750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=652a536d-be25-4d52-b18f-a99cbd9138a8,host='devstack@QuobyteHD#QuobyteHD',id=27005b4d-ac3a-4a8f-b79b-06db5b22e52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:55Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f727d8ed-c692-490b-85b4-a97e19842077),volume_type_id=f727d8ed-c692-490b-85b4-a97e19842077)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Creating volume 27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:07 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:07 devstack sudo[127465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c 1073741824 Jun 23 14:08:07 devstack sudo[127465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88c1594c-ade2-47ca-b344-32610065844d', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:08:07 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-ba61014b-9a86-4682-a728-6d0a38d9d905 req-99b06ee9-2219-4348-89e9-fc52e925f8cb tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] attachment_update completed successfully. Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Acquiring lock "cinder-883538de-6e74-403b-9816-00c91afcec04-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Acquiring lock "cinder-quobyte-883538de-6e74-403b-9816-00c91afcec04" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Lock "cinder-quobyte-883538de-6e74-403b-9816-00c91afcec04" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c5e57c-9a26-4dc7-825f-ebdd8e35eb17]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:08 devstack sudo[127532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:08:08 devstack sudo[127532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:08 devstack sudo[127465]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c 1073741824" returned: 0 in 1.102s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:08 devstack sudo[127573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c Jun 23 14:08:08 devstack sudo[127573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:09 devstack sudo[127532]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.960s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:09 devstack sudo[127912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04 Jun 23 14:08:09 devstack sudo[127912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:09 devstack sudo[127573]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" returned: 0 in 0.741s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.493s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating offline snapshot 62732f3d-0060-4462-86c3-56fcba5b5e35 of volume 31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488a6ada-0fc6-4ec5-bc9d-c2489387576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc47811-cfa6-46d7-99cc-ad30f74156fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b9dbd-1b00-4182-b5c5-ee0ed80586da]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Volume volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c (27005b4d-ac3a-4a8f-b79b-06db5b22e52c): created successfully Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc47811-cfa6-46d7-99cc-ad30f74156fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (c44545b2-4739-46c2-9e83-453ceab4908c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-505b2b48-06ef-4150-a60a-9e8d70cd3e51 tempest-GroupSnapshotsTest-598976176 None] Created volume successfully. Jun 23 14:08:09 devstack sudo[127924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 Jun 23 14:08:09 devstack sudo[127924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:10 devstack sudo[127912]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-883538de-6e74-403b-9816-00c91afcec04" returned: 0 in 0.738s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Lock "cinder-quobyte-883538de-6e74-403b-9816-00c91afcec04" released by "delete_volume" :: held 1.743s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Created reservations ['1bd94561-68da-4297-986d-132e72d8b770', '2ce0e603-41b8-4b55-a432-6c1a7cf83e4a', '8ff03544-023f-4261-a52a-beef8ee1a1f1', '047f3011-0ead-40f1-87f8-f57a7751db95'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:10 devstack sudo[127945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:10 devstack sudo[127945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:10 devstack sudo[127924]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" returned: 0 in 0.874s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:10 devstack sudo[127959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 1G Jun 23 14:08:10 devstack sudo[127959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:11 devstack sudo[127945]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.714s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:11 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Deleted volume successfully. Jun 23 14:08:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9232467d-7474-4da7-9636-da3decd13215 tempest-VolumesActionsTest-108705956 None] Lock "cinder-883538de-6e74-403b-9816-00c91afcec04-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-50ea8aee-9588-44b6-9644-60c40a45b03b tempest-GroupSnapshotsTest-598976176 None] Update group completed successfully. Jun 23 14:08:11 devstack sudo[127959]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 1G" returned: 0 in 1.066s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:11 devstack sudo[127996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 Jun 23 14:08:11 devstack sudo[127996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:12 devstack sudo[127996]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35" returned: 0 in 0.816s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:12 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 is being set with open permissions: ugo+rw Jun 23 14:08:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:12 devstack sudo[128026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 Jun 23 14:08:12 devstack sudo[128026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:12 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-635b0617-6373-4c16-ba03-b34d16f920e7 tempest-GroupSnapshotsTest-598976176 None] Update group completed successfully. Jun 23 14:08:13 devstack sudo[128026]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35" returned: 0 in 0.720s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:13 devstack sudo[128053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info Jun 23 14:08:13 devstack sudo[128053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-27aa5610-8c58-4ddc-bc30-150565cfea38 tempest-GroupSnapshotsTest-598976176 None] Update group completed successfully. Jun 23 14:08:14 devstack sudo[128053]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info" returned: 0 in 0.896s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:14 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info is being set with open permissions: ugo+rw Jun 23 14:08:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:14 devstack sudo[128083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info Jun 23 14:08:14 devstack sudo[128083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:15 devstack sudo[128083]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.info" returned: 0 in 0.949s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.454s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5d75fd1d-4d45-4217-ace9-ac9f049238ff tempest-GroupSnapshotsTest-598976176 None] Update group completed successfully. Jun 23 14:08:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a410c280-3463-405c-86ee-00e79f96cd3a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Create snapshot completed successfully Jun 23 14:08:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-ea7c7e78-310b-4483-b0ab-47122f30f667 req-3bd265a6-c508-4875-8c20-dd53fd071172 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Terminate volume connection completed successfully. Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-ea7c7e78-310b-4483-b0ab-47122f30f667 req-3bd265a6-c508-4875-8c20-dd53fd071172 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Deleting attachment 88c1594c-ade2-47ca-b344-32610065844d. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (8c611c65-0e8a-4352-9d2a-3ebb7be57b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa06965-037e-44a2-9087-1a3c6e8bc5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa06965-037e-44a2-9087-1a3c6e8bc5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015379267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ad06c-9b13-4c71-9f8d-b99f9f25549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:17Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb156eb-dc1f-4ea0-86e7-3ebe777c84f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb156eb-dc1f-4ea0-86e7-3ebe777c84f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63285d4e-09d8-4138-a0c6-f9f590ee60f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63285d4e-09d8-4138-a0c6-f9f590ee60f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611ad06c-9b13-4c71-9f8d-b99f9f25549e', 'volume_name': 'volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbb60ff-9707-42b5-a8ac-ec268ec40d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbb60ff-9707-42b5-a8ac-ec268ec40d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354c1d93-74cd-43dd-a66a-ba35bcc02af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume 611ad06c-9b13-4c71-9f8d-b99f9f25549e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e', 'volume_size': 1} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015379267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ad06c-9b13-4c71-9f8d-b99f9f25549e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:17Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating volume 611ad06c-9b13-4c71-9f8d-b99f9f25549e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:16 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] GroupSnapshot d742e9e2-70cb-41ec-ae9f-ebe6e02b6821: creating. Jun 23 14:08:16 devstack sudo[128199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e 1073741824 Jun 23 14:08:16 devstack sudo[128199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Group snapshot d742e9e2-70cb-41ec-ae9f-ebe6e02b6821: creating. {{(pid=93689) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:08:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (64e90311-6545-4c18-912b-c4cef58ff3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbe0ec9-de37-4cca-a2bb-df74cda2cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbe0ec9-de37-4cca-a2bb-df74cda2cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964397346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c4e7a8-0308-4f98-a800-468f5f45a903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:18Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f433426-eee6-4c7e-9f64-67d7d4dd494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f433426-eee6-4c7e-9f64-67d7d4dd494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7d547f-200b-4d81-a882-80f1178bafa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7d547f-200b-4d81-a882-80f1178bafa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c4e7a8-0308-4f98-a800-468f5f45a903', 'volume_name': 'volume-a6c4e7a8-0308-4f98-a800-468f5f45a903', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e38c146-3a49-4d34-9875-d84027fd964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e38c146-3a49-4d34-9875-d84027fd964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb4cfc1-2d21-4379-8062-a05db56008b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:17 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume a6c4e7a8-0308-4f98-a800-468f5f45a903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c4e7a8-0308-4f98-a800-468f5f45a903', 'volume_size': 1} Jun 23 14:08:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:18 devstack sudo[128199]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e 1073741824" returned: 0 in 1.334s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (eb155427-d55a-47ad-a4ea-58e1bebd01ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c32ced-8215-4aab-b657-513c2713ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c32ced-8215-4aab-b657-513c2713ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1572356504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab24574-8c49-49f8-b983-30ec082ba1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:18Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3c0e97-72da-4a18-b9be-12a22fbc2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3c0e97-72da-4a18-b9be-12a22fbc2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea538cd-82b6-4992-9f14-7be000fd62ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea538cd-82b6-4992-9f14-7be000fd62ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab24574-8c49-49f8-b983-30ec082ba1fc', 'volume_name': 'volume-dab24574-8c49-49f8-b983-30ec082ba1fc', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906190f3-f6d5-4127-a8aa-eafc51223ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906190f3-f6d5-4127-a8aa-eafc51223ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efa4c2c-6d03-4739-805d-4bfb6baef250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:18 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume dab24574-8c49-49f8-b983-30ec082ba1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab24574-8c49-49f8-b983-30ec082ba1fc', 'volume_size': 1} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:18 devstack sudo[128250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e Jun 23 14:08:18 devstack sudo[128250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (6c47cf8c-199e-4305-8620-8005d25e26e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f127bc37-efd4-43a8-b8e2-4e5f64b2997f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Acquiring lock "cinder-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f127bc37-efd4-43a8-b8e2-4e5f64b2997f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-270116548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4249ad72-01d8-4f2b-8eb3-394963aa2492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:19Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5a4032-bd6b-48fe-8073-a6428be6237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5a4032-bd6b-48fe-8073-a6428be6237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c625b4-437a-4ffc-b145-ffa9615ff1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c625b4-437a-4ffc-b145-ffa9615ff1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4249ad72-01d8-4f2b-8eb3-394963aa2492', 'volume_name': 'volume-4249ad72-01d8-4f2b-8eb3-394963aa2492', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1703f5d-90ef-4fb6-b44f-0bfa182dfae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1703f5d-90ef-4fb6-b44f-0bfa182dfae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0edb0cd-e98d-4349-9611-b56c515bc5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume 4249ad72-01d8-4f2b-8eb3-394963aa2492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4249ad72-01d8-4f2b-8eb3-394963aa2492', 'volume_size': 1} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "cinder-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Acquiring lock "cinder-quobyte-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "cinder-quobyte-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b3801-7fe3-4dee-acf2-3be581ddf677]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:19 devstack sudo[128250]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e" returned: 0 in 0.946s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.448s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354c1d93-74cd-43dd-a66a-ba35bcc02af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6d379f-b7c8-4cf0-bf01-64cf77918bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Creating offline snapshot 8d03f630-2813-4dac-aab0-a56a9bc9805f of volume 2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e (611ad06c-9b13-4c71-9f8d-b99f9f25549e): created successfully Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6d379f-b7c8-4cf0-bf01-64cf77918bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (8c611c65-0e8a-4352-9d2a-3ebb7be57b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae39a8be-3bb5-4542-8a2d-749ea593bebe]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:19 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-be2a170c-4ed6-4a9c-b816-13f7fef6387a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created volume successfully. Jun 23 14:08:19 devstack sudo[128280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc Jun 23 14:08:19 devstack sudo[128280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (9f3c02cd-ed1b-4063-88b8-14af53e2ecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09dd01d6-ad19-45fa-9ac5-ae9bb2b5ec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09dd01d6-ad19-45fa-9ac5-ae9bb2b5ec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019282874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2fdd25-5295-491f-9d0c-aa9d26ea50de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:19Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbeb894-d004-4184-afc2-0e32511d42e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbeb894-d004-4184-afc2-0e32511d42e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3cab80-3f23-467f-b60f-aa52aff92323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3cab80-3f23-467f-b60f-aa52aff92323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d2fdd25-5295-491f-9d0c-aa9d26ea50de', 'volume_name': 'volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a84229-b39e-4b99-8fb2-d7001ec2cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a84229-b39e-4b99-8fb2-d7001ec2cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a80c8df-1ddd-45e2-abb1-879de488c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume 8d2fdd25-5295-491f-9d0c-aa9d26ea50de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de', 'volume_size': 1} Jun 23 14:08:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:19 devstack sudo[128284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 Jun 23 14:08:19 devstack sudo[128284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:20 devstack sudo[128280]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:20 devstack sudo[128320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc Jun 23 14:08:20 devstack sudo[128320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:20 devstack sudo[128284]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" returned: 0 in 0.968s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:20 devstack sudo[128325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f 1G Jun 23 14:08:20 devstack sudo[128325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:21 devstack sudo[128320]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" returned: 0 in 0.844s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "cinder-quobyte-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc" released by "delete_volume" :: held 1.880s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Created reservations ['0abd206c-796f-4d6d-adb6-21bf13b23bc3', '7fb7261b-21d5-4d43-86db-9d0a9b0474db', 'f46a44d0-b357-4bc5-8f51-aa4b3c13033c', 'f5dbd124-65cc-467f-afc9-672b64b928dd'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:21 devstack sudo[128359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:21 devstack sudo[128359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:21 devstack sudo[128325]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f 1G" returned: 0 in 0.993s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:21 devstack sudo[128364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f Jun 23 14:08:21 devstack sudo[128364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:22 devstack sudo[128359]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.813s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:22 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Deleted volume successfully. Jun 23 14:08:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0dbd0253-3b41-4b70-89ad-99b9b48d9226 tempest-TestServerVolumeAttachScenarioOldVersion-618379485 None] Lock "cinder-bf0d6adf-c9f5-48c2-a5c7-124dac20c1cc-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:22 devstack sudo[128364]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f" returned: 0 in 0.851s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:08:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:22 devstack sudo[128394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f Jun 23 14:08:22 devstack sudo[128394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:22 devstack sudo[128394]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f" returned: 0 in 0.731s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:23 devstack sudo[128421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info Jun 23 14:08:23 devstack sudo[128421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:24 devstack sudo[128421]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info" returned: 0 in 1.021s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:24 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:24 devstack sudo[128489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info Jun 23 14:08:24 devstack sudo[128489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:24 devstack sudo[128489]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.info" returned: 0 in 0.705s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.413s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Creating offline snapshot e184119d-ee12-49fb-8939-58d5d69daf47 of volume 27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceffe24e-ed6f-45bc-b6f8-06cb2cd95198]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:24 devstack sudo[128517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c Jun 23 14:08:24 devstack sudo[128517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:25 devstack sudo[128517]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" returned: 0 in 0.941s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:25 devstack sudo[128551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 1G Jun 23 14:08:25 devstack sudo[128551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:26 devstack sudo[128551]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 1G" returned: 0 in 1.084s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:26 devstack sudo[128592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 Jun 23 14:08:26 devstack sudo[128592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:27 devstack sudo[128592]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47" returned: 0 in 1.093s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:27 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:08:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:28 devstack sudo[128632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 Jun 23 14:08:28 devstack sudo[128632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:28 devstack sudo[128632]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47" returned: 0 in 0.898s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:28 devstack sudo[128662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info Jun 23 14:08:28 devstack sudo[128662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (b8f50116-104a-45d7-84e4-f0b2455dc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e40261f-eb83-42da-a887-e1651ea63e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e40261f-eb83-42da-a887-e1651ea63e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1396255155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d3c639-5b25-4fab-94d4-d14bb6a53d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:29Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dd5be2-07b6-4b3c-b898-90e3fb9e1302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dd5be2-07b6-4b3c-b898-90e3fb9e1302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23aa06f6-9ac5-488a-8125-6fa278a21999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23aa06f6-9ac5-488a-8125-6fa278a21999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d3c639-5b25-4fab-94d4-d14bb6a53d6f', 'volume_name': 'volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9aefd75-72a3-4051-9a21-3c2d4d4ea674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9aefd75-72a3-4051-9a21-3c2d4d4ea674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce10552-25d3-45da-9fed-bfb810f9958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:29 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Volume a4d3c639-5b25-4fab-94d4-d14bb6a53d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f', 'volume_size': 1} Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:29 devstack sudo[128662]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:29 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:08:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:29 devstack sudo[128694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info Jun 23 14:08:29 devstack sudo[128694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:30 devstack sudo[128694]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.info" returned: 0 in 0.758s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.857s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.257s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1572356504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab24574-8c49-49f8-b983-30ec082ba1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:18Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating volume dab24574-8c49-49f8-b983-30ec082ba1fc {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:30 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:30 devstack sudo[128719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc 1073741824 Jun 23 14:08:30 devstack sudo[128719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:30 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-fe5299be-c5b0-47de-8e06-707dc64b691b tempest-GroupSnapshotsTest-598976176 None] group_snapshot d742e9e2-70cb-41ec-ae9f-ebe6e02b6821: created successfully Jun 23 14:08:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] group_snapshot d742e9e2-70cb-41ec-ae9f-ebe6e02b6821: deleting Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] group_snapshot d742e9e2-70cb-41ec-ae9f-ebe6e02b6821: deleting {{(pid=93689) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-8d03f630-2813-4dac-aab0-a56a9bc9805f" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-8d03f630-2813-4dac-aab0-a56a9bc9805f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Deleting offline snapshot 8d03f630-2813-4dac-aab0-a56a9bc9805f of volume 2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] snapshot_file for this snap is: volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4917f-e523-4c93-929f-13d1f5005c54]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:31 devstack sudo[128743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f Jun 23 14:08:31 devstack sudo[128743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:31 devstack sudo[128719]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc 1073741824" returned: 0 in 1.034s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:31 devstack sudo[128760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc Jun 23 14:08:31 devstack sudo[128760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:32 devstack sudo[128743]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f" returned: 0 in 1.055s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c53833e-c6a8-4823-89f9-1316e78aa61b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:32 devstack sudo[128760]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc" returned: 0 in 0.730s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.270s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-270116548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4249ad72-01d8-4f2b-8eb3-394963aa2492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:19Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating volume 4249ad72-01d8-4f2b-8eb3-394963aa2492 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:32 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:32 devstack sudo[128784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 Jun 23 14:08:32 devstack sudo[128784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:32 devstack sudo[128792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 1073741824 Jun 23 14:08:32 devstack sudo[128792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efa4c2c-6d03-4739-805d-4bfb6baef250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab24574-8c49-49f8-b983-30ec082ba1fc', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d0d142-0590-4b4c-80ba-d23b8a8786b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume volume-dab24574-8c49-49f8-b983-30ec082ba1fc (dab24574-8c49-49f8-b983-30ec082ba1fc): created successfully Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d0d142-0590-4b4c-80ba-d23b8a8786b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (eb155427-d55a-47ad-a4ea-58e1bebd01ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8df13cb1-1bc7-4d8c-80cd-08c0469186b4 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created volume successfully. Jun 23 14:08:33 devstack sudo[128784]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" returned: 0 in 0.955s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:33 devstack sudo[128825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f Jun 23 14:08:33 devstack sudo[128825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:33 devstack sudo[128792]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 1073741824" returned: 0 in 1.184s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:33 devstack sudo[128840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 Jun 23 14:08:33 devstack sudo[128840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:34 devstack sudo[128825]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f" returned: 0 in 0.820s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:34 devstack sudo[128857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f Jun 23 14:08:34 devstack sudo[128857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:34 devstack sudo[128840]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492" returned: 0 in 0.761s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.905s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019282874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2fdd25-5295-491f-9d0c-aa9d26ea50de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:19Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating volume 8d2fdd25-5295-491f-9d0c-aa9d26ea50de {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:34 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:34 devstack sudo[128873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de 1073741824 Jun 23 14:08:34 devstack sudo[128873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0edb0cd-e98d-4349-9611-b56c515bc5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4249ad72-01d8-4f2b-8eb3-394963aa2492', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1e2278-7f9a-4000-8099-4775306e4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 (4249ad72-01d8-4f2b-8eb3-394963aa2492): created successfully Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1e2278-7f9a-4000-8099-4775306e4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (6c47cf8c-199e-4305-8620-8005d25e26e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:34 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0733a13d-94ac-4f7f-ba87-773672ebcd8e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created volume successfully. Jun 23 14:08:34 devstack sudo[128857]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35.8d03f630-2813-4dac-aab0-a56a9bc9805f" returned: 0 in 0.787s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-8d03f630-2813-4dac-aab0-a56a9bc9805f" released by "_delete_snapshot" :: held 3.736s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" released by "delete_snapshot" :: held 3.767s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-e184119d-ee12-49fb-8939-58d5d69daf47" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-e184119d-ee12-49fb-8939-58d5d69daf47" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Deleting offline snapshot e184119d-ee12-49fb-8939-58d5d69daf47 of volume 27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] snapshot_file for this snap is: volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[5263da2a-0659-43ac-a0dd-2c5f2cd42ba2]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:35 devstack sudo[128892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 Jun 23 14:08:35 devstack sudo[128892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:35 devstack sudo[128873]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de 1073741824" returned: 0 in 1.079s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:35 devstack sudo[128918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de Jun 23 14:08:35 devstack sudo[128918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47" returned: 0 in 0.915s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:35 devstack sudo[128892]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa59c349-7853-4342-82cf-9c6bbf6a6235]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:36 devstack sudo[128935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c Jun 23 14:08:36 devstack sudo[128935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:36 devstack sudo[128918]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de" returned: 0 in 0.758s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.593s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-964397346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c4e7a8-0308-4f98-a800-468f5f45a903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9a4d5d84775439dbd4805e544379c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:18Z,use_quota=True,user_id='54fc790c62bf4252b61e0a505ba85ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Creating volume a6c4e7a8-0308-4f98-a800-468f5f45a903 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:36 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a80c8df-1ddd-45e2-abb1-879de488c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea55a8dd-ef4a-453d-9d4c-03e3a0582863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de (8d2fdd25-5295-491f-9d0c-aa9d26ea50de): created successfully Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea55a8dd-ef4a-453d-9d4c-03e3a0582863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:36 devstack sudo[128950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 1073741824 Jun 23 14:08:36 devstack sudo[128950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (9f3c02cd-ed1b-4063-88b8-14af53e2ecc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4ccaa5ea-d62c-4a66-a330-a3f0569eb687 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created volume successfully. Jun 23 14:08:37 devstack sudo[128935]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" returned: 0 in 1.107s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:37 devstack sudo[128978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 Jun 23 14:08:37 devstack sudo[128978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:37 devstack sudo[128950]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 1073741824" returned: 0 in 1.178s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:37 devstack sudo[128999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 Jun 23 14:08:37 devstack sudo[128999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:38 devstack sudo[128978]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47" returned: 0 in 0.892s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:38 devstack sudo[129016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47 Jun 23 14:08:38 devstack sudo[129016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:38 devstack sudo[128999]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903" returned: 0 in 0.809s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.828s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1396255155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d3c639-5b25-4fab-94d4-d14bb6a53d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:29Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Creating volume a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:38 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb4cfc1-2d21-4379-8062-a05db56008b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c4e7a8-0308-4f98-a800-468f5f45a903', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63989e14-e878-4210-99f2-3c3dcf85472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:38 devstack sudo[129031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f 1073741824 Jun 23 14:08:38 devstack sudo[129031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:38 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Volume volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 (a6c4e7a8-0308-4f98-a800-468f5f45a903): created successfully Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63989e14-e878-4210-99f2-3c3dcf85472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Flow 'volume_create_manager' (64e90311-6545-4c18-912b-c4cef58ff3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8edfe57d-001a-42b2-b940-8b6652b961bf tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created volume successfully. Jun 23 14:08:38 devstack sudo[129016]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c.e184119d-ee12-49fb-8939-58d5d69daf47" returned: 0 in 0.782s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-e184119d-ee12-49fb-8939-58d5d69daf47" released by "_delete_snapshot" :: held 3.845s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" released by "delete_snapshot" :: held 3.875s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:38 devstack cinder-volume[93689]: WARNING cinder.quota [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-189788199 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-189788199, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:38 devstack cinder-volume[93689]: WARNING cinder.quota [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-189788199 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-189788199, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:38 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Created reservations ['8c2cfeb0-7f79-4e76-81d6-41383b056625', '2f9453c6-a98e-4af2-a61c-f2909403cd4f', '148510dc-ea57-4e17-ae22-df9ced795c53', '27627f26-308a-4aad-b062-ad3d79850d33'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] Created reservations ['83282620-4de4-4716-91cb-ca0770c9c219', '22f2ef1a-ecdf-42e5-9a62-8604860b95da', 'a48955f3-95ab-408c-804e-aa6371b14f6b', '78128bff-0440-4c54-9b81-c09d66ee41e0'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0e9f65c3-6869-488a-b342-de6495cd707d tempest-GroupSnapshotsTest-598976176 None] group_snapshot d742e9e2-70cb-41ec-ae9f-ebe6e02b6821: deleted successfully Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-8d2fdd25-5295-491f-9d0c-aa9d26ea50de-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-8d2fdd25-5295-491f-9d0c-aa9d26ea50de-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-8d2fdd25-5295-491f-9d0c-aa9d26ea50de" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-8d2fdd25-5295-491f-9d0c-aa9d26ea50de" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd60c99-f1a9-4fb1-9312-be72b3e385ce]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:39 devstack sudo[129031]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f 1073741824" returned: 0 in 1.107s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:39 devstack sudo[129071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de Jun 23 14:08:39 devstack sudo[129076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f Jun 23 14:08:39 devstack sudo[129076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:39 devstack sudo[129071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[79616213-91ed-406b-a44a-dda32af799e9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:40 devstack sudo[129071]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de" returned: 0 in 1.204s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:40 devstack sudo[129076]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" returned: 0 in 1.084s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:40 devstack sudo[129146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c Jun 23 14:08:40 devstack sudo[129146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:40 devstack sudo[129152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de Jun 23 14:08:40 devstack sudo[129152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce10552-25d3-45da-9fed-bfb810f9958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b051ca14-b8f2-4e55-bb63-866de4181a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:40 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Volume volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f (a4d3c639-5b25-4fab-94d4-d14bb6a53d6f): created successfully Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b051ca14-b8f2-4e55-bb63-866de4181a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (b8f50116-104a-45d7-84e4-f0b2455dc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:40 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-36df3e58-dc7b-4be0-8cf5-aba6874e55da tempest-VolumesSnapshotTestJSON-8168811 None] Created volume successfully. Jun 23 14:08:41 devstack sudo[129152]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8d2fdd25-5295-491f-9d0c-aa9d26ea50de" returned: 0 in 0.901s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-8d2fdd25-5295-491f-9d0c-aa9d26ea50de" released by "delete_volume" :: held 2.208s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:41 devstack sudo[129146]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" returned: 0 in 1.191s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:41 devstack sudo[129190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c Jun 23 14:08:41 devstack sudo[129190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['13b99f4a-7be0-47c2-aa19-dc43dccf7fba', '01920f71-2300-4705-bce4-5d49664b2d55', '563a3598-31cd-4429-a532-6e2bb1f4c4c9', 'ae3004e4-c437-424b-99fe-8b6ab7bfd387'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Creating offline snapshot 7bd3026b-5fde-4f99-9dcb-6ca215c819eb of volume a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b77a0b-5c64-4ce3-b113-3df3ba300b3d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:42 devstack sudo[129198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:42 devstack sudo[129198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:42 devstack sudo[129199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f Jun 23 14:08:42 devstack sudo[129199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:42 devstack sudo[129190]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" returned: 0 in 0.931s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-27005b4d-ac3a-4a8f-b79b-06db5b22e52c" released by "delete_volume" :: held 2.218s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" acquired by "delete_volume" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a534b-53dc-421f-9959-ab663c510fd0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:42 devstack sudo[129198]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.878s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleted volume successfully. Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf80a4c8-4f55-4ade-b0c5-7597ae9ebe97 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-8d2fdd25-5295-491f-9d0c-aa9d26ea50de-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-4249ad72-01d8-4f2b-8eb3-394963aa2492-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-4249ad72-01d8-4f2b-8eb3-394963aa2492-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-4249ad72-01d8-4f2b-8eb3-394963aa2492" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:43 devstack sudo[129229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 Jun 23 14:08:43 devstack sudo[129229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-4249ad72-01d8-4f2b-8eb3-394963aa2492" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68bb83-e57d-4406-9474-a747cdbcc0ac]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:43 devstack sudo[129199]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" returned: 0 in 1.162s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:43 devstack sudo[129244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb 1G Jun 23 14:08:43 devstack sudo[129244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:43 devstack sudo[129243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 Jun 23 14:08:43 devstack sudo[129243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:43 devstack sudo[129229]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" returned: 0 in 1.165s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:44 devstack sudo[129280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35 Jun 23 14:08:44 devstack sudo[129280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:44 devstack sudo[129243]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492" returned: 0 in 1.004s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:44 devstack sudo[129289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492 Jun 23 14:08:44 devstack sudo[129289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:44 devstack sudo[129244]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb 1G" returned: 0 in 1.168s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:44 devstack sudo[129297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb Jun 23 14:08:44 devstack sudo[129297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:44 devstack sudo[129280]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" returned: 0 in 0.954s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:44 devstack sudo[129289]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4249ad72-01d8-4f2b-8eb3-394963aa2492" returned: 0 in 0.827s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:44 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-2c35b007-be75-4b56-ab3a-ca3d8bf93a35" released by "delete_volume" :: held 2.229s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-4249ad72-01d8-4f2b-8eb3-394963aa2492" released by "delete_volume" :: held 1.928s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['845a903d-f3c0-4124-accd-1eb900ac1a0e', '3799b165-fea6-45ef-bd08-daf865fca1b2', 'd0076cdf-e524-406e-ab95-976aaa27613f', '42ca8c88-5d2c-4b96-955d-ab765d6dc55f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Created reservations ['57766012-2cd6-450f-8302-382a2b12dd43'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:45 devstack cinder-volume[93689]: WARNING cinder.quota [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-189788199 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-189788199, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=81,cinder:INSERT=21,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:45 devstack sudo[129297]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb" returned: 0 in 0.930s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:45 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb is being set with open permissions: ugo+rw Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Created reservations ['0d6117de-6847-43ab-ad39-5d08720a4760', '30aa23fd-b85a-4504-8b57-5a897a55f978', 'ce85337e-0cd5-4630-8998-fc342430d37f', '0ca22eef-f9fd-44db-8d4f-e05c1454c28a'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:45 devstack sudo[129332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:45 devstack sudo[129332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:45 devstack sudo[129333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb Jun 23 14:08:45 devstack sudo[129333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-dab24574-8c49-49f8-b983-30ec082ba1fc-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-dab24574-8c49-49f8-b983-30ec082ba1fc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=97,cinder:SELECT=94,cinder:DELETE=7,cinder:INSERT=21 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-dab24574-8c49-49f8-b983-30ec082ba1fc" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-dab24574-8c49-49f8-b983-30ec082ba1fc" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5cc77-6608-4341-b30f-4698801e6224]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Created reservations ['194af9ff-50e0-441f-8b2e-fd1b06997e56', '2003cd76-06ed-48ae-8cd9-303228677381', '196f5fa1-e2da-4682-9c5a-d92cb0c0b70d', '5831e679-83ba-4145-a47e-7161af503277'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:45 devstack sudo[129344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc Jun 23 14:08:45 devstack sudo[129344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:45 devstack sudo[129352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:45 devstack sudo[129352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:46 devstack sudo[129332]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.260s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleted volume successfully. Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3d82ec68-9849-45a8-9bd3-b70a7fd3868a tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-4249ad72-01d8-4f2b-8eb3-394963aa2492-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:46 devstack sudo[129352]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.962s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:46 devstack sudo[129344]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc" returned: 0 in 1.177s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:46 devstack sudo[129333]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a71e2c18-63df-45cf-bf82-f050efbaadea tempest-GroupSnapshotsTest-598976176 None] Delete group completed successfully. Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb" returned: 0 in 1.447s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:46 devstack sudo[129389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc Jun 23 14:08:46 devstack sudo[129389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c34de7bb-637a-4d0a-b695-e05607165fd5 tempest-GroupSnapshotsTest-598976176 None] Group tempest-GroupSnapshotsTest-Group-710584049: creating Jun 23 14:08:46 devstack sudo[129394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info Jun 23 14:08:46 devstack sudo[129394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c34de7bb-637a-4d0a-b695-e05607165fd5 tempest-GroupSnapshotsTest-598976176 None] Group tempest-GroupSnapshotsTest-Group-710584049: created successfully Jun 23 14:08:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c34de7bb-637a-4d0a-b695-e05607165fd5 tempest-GroupSnapshotsTest-598976176 None] Create group completed successfully. Jun 23 14:08:47 devstack sudo[129389]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dab24574-8c49-49f8-b983-30ec082ba1fc" returned: 0 in 0.818s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-dab24574-8c49-49f8-b983-30ec082ba1fc" released by "delete_volume" :: held 2.087s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:47 devstack sudo[129394]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['d944456d-07e9-462f-adfe-3a02b8fbb103', '12cdd57c-4315-4b8a-9924-34c1eae707ee', 'ebdd6881-2529-40bf-a0cf-83694f497906', 'a0891d72-a50d-4cc9-8383-e96c9c2cf5bb'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info" returned: 0 in 0.821s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:47 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info is being set with open permissions: ugo+rw Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:47 devstack sudo[129422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info Jun 23 14:08:47 devstack sudo[129422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:47 devstack sudo[129430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:47 devstack sudo[129430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-a6c4e7a8-0308-4f98-a800-468f5f45a903-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-a6c4e7a8-0308-4f98-a800-468f5f45a903-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-a6c4e7a8-0308-4f98-a800-468f5f45a903" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-a6c4e7a8-0308-4f98-a800-468f5f45a903" acquired by "delete_volume" :: waited 0.034s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f16aac-4ac8-4e96-b9ba-c71c6b7f55cd]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:48 devstack sudo[129441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 Jun 23 14:08:48 devstack sudo[129441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:48 devstack sudo[129430]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:48 devstack sudo[129422]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.info" returned: 0 in 1.210s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.060s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.911s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleted volume successfully. Jun 23 14:08:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-cd032f8a-02cd-4ab0-ba61-54d8dd1a1938 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-dab24574-8c49-49f8-b983-30ec082ba1fc-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-94fdc93b-5db6-4d70-be8e-c632704d0e14 tempest-VolumesSnapshotTestJSON-8168811 None] Create snapshot completed successfully Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (999ad0ee-d1d8-410f-ade6-fdec559698a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d4173c-848f-492e-9e78-2a875feef337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d4173c-848f-492e-9e78-2a875feef337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-209804552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe116fee-21b8-459b-acec-774307ae6393,host='devstack@QuobyteHD#QuobyteHD',id=a1a41269-2763-4ec3-9bd0-6d303a2efbd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:49Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5abf1317-0620-4e8d-8f23-e1232d952721),volume_type_id=5abf1317-0620-4e8d-8f23-e1232d952721)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a3190-abbc-492d-bd95-76253f98d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26a3190-abbc-492d-bd95-76253f98d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24e3e2d-53aa-4d3a-b196-7bd08bbb1d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24e3e2d-53aa-4d3a-b196-7bd08bbb1d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a41269-2763-4ec3-9bd0-6d303a2efbd7', 'volume_name': 'volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087d624b-0be4-4ee9-84d4-e1f5c01860c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087d624b-0be4-4ee9-84d4-e1f5c01860c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53369328-7462-45b2-9589-180386747ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Volume a1a41269-2763-4ec3-9bd0-6d303a2efbd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7', 'volume_size': 1} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe116fee-21b8-459b-acec-774307ae6393,created_at=2026-06-23T12:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-209804552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe116fee-21b8-459b-acec-774307ae6393,host='devstack@QuobyteHD#QuobyteHD',id=a1a41269-2763-4ec3-9bd0-6d303a2efbd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb39bc713e4d79ab5cd89db2f160f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:49Z,use_quota=True,user_id='46deae9cc86140bfb1be12ee2e73a1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5abf1317-0620-4e8d-8f23-e1232d952721),volume_type_id=5abf1317-0620-4e8d-8f23-e1232d952721)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Creating volume a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:49 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:49 devstack sudo[129484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 1073741824 Jun 23 14:08:49 devstack sudo[129484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:49 devstack sudo[129441]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903" returned: 0 in 1.388s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:49 devstack sudo[129492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903 Jun 23 14:08:49 devstack sudo[129492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-7bd3026b-5fde-4f99-9dcb-6ca215c819eb-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-7bd3026b-5fde-4f99-9dcb-6ca215c819eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-7bd3026b-5fde-4f99-9dcb-6ca215c819eb" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-7bd3026b-5fde-4f99-9dcb-6ca215c819eb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Deleting offline snapshot 7bd3026b-5fde-4f99-9dcb-6ca215c819eb of volume a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] snapshot_file for this snap is: volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5bee80-eb98-43f9-8ea8-15a94b4a5735]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:49 devstack sudo[129503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb Jun 23 14:08:49 devstack sudo[129503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:50 devstack sudo[129492]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a6c4e7a8-0308-4f98-a800-468f5f45a903" returned: 0 in 0.927s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-a6c4e7a8-0308-4f98-a800-468f5f45a903" released by "delete_volume" :: held 2.413s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:50 devstack sudo[129484]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 1073741824" returned: 0 in 1.172s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:50 devstack sudo[129531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 Jun 23 14:08:50 devstack sudo[129531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['9591c3b8-6890-4ee8-a680-0652955665a7', 'e9214435-5f0b-47a0-8b81-7c7deec303c1', '469dea00-e89e-45fd-ab6c-2dc7c7c75c56', '4183ba10-300a-484f-a3ef-cb451c6392e1'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:50 devstack sudo[129539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:50 devstack sudo[129539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:50 devstack sudo[129503]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb" returned: 0 in 1.013s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa44fe4-3973-448c-a7bf-fef17d77edcb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:50 devstack sudo[129547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f Jun 23 14:08:50 devstack sudo[129547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-611ad06c-9b13-4c71-9f8d-b99f9f25549e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-611ad06c-9b13-4c71-9f8d-b99f9f25549e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:51 devstack sudo[129531]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" returned: 0 in 0.939s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-611ad06c-9b13-4c71-9f8d-b99f9f25549e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53369328-7462-45b2-9589-180386747ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71a1b2-eae3-46b0-8501-204b4cc8a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:51 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Volume volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 (a1a41269-2763-4ec3-9bd0-6d303a2efbd7): created successfully Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71a1b2-eae3-46b0-8501-204b4cc8a83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Flow 'volume_create_manager' (999ad0ee-d1d8-410f-ade6-fdec559698a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-611ad06c-9b13-4c71-9f8d-b99f9f25549e" acquired by "delete_volume" :: waited 0.065s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-fe4e95b6-6c02-4281-8036-94f0f1d81ee1 tempest-GroupSnapshotsTest-598976176 None] Created volume successfully. Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a8aaf-315b-4805-9b7e-1ce5e11127f6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:51 devstack sudo[129539]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.924s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleted volume successfully. Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c001fc9a-078f-4948-8e6d-0c974898fa37 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-a6c4e7a8-0308-4f98-a800-468f5f45a903-delete_volume" released by "delete_volume" :: held 3.727s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:51 devstack sudo[129572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e Jun 23 14:08:51 devstack sudo[129572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:51 devstack sudo[129547]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" returned: 0 in 1.027s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:51 devstack sudo[129586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb Jun 23 14:08:51 devstack sudo[129586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:52 devstack sudo[129572]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e" returned: 0 in 0.908s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:52 devstack sudo[129609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e Jun 23 14:08:52 devstack sudo[129609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:52 devstack sudo[129586]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb" returned: 0 in 0.940s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:52 devstack sudo[129627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb Jun 23 14:08:52 devstack sudo[129627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] GroupSnapshot d660d51b-dee3-40fa-80b9-35751960797d: creating. Jun 23 14:08:53 devstack sudo[129609]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-611ad06c-9b13-4c71-9f8d-b99f9f25549e" returned: 0 in 0.714s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Group snapshot d660d51b-dee3-40fa-80b9-35751960797d: creating. {{(pid=93689) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-611ad06c-9b13-4c71-9f8d-b99f9f25549e" released by "delete_volume" :: held 1.690s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Creating offline snapshot 5f7d56b8-48c5-4bd0-96ac-97a383f1d83b of volume a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5cbc9a-fad8-411f-9e0c-bfaab44fd59e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['6b1fa1a7-6685-4b7b-ad65-6dd849d53b82', '1b0908ed-19a3-408f-b589-22e53d823977', '02090880-7f10-4ae6-85dd-a8a64870592d', '4c6c2522-5d84-499d-bfa7-0dbe4288a5c7'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:53 devstack sudo[129642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 Jun 23 14:08:53 devstack sudo[129642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:53 devstack sudo[129649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:08:53 devstack sudo[129649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-62732f3d-0060-4462-86c3-56fcba5b5e35-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-62732f3d-0060-4462-86c3-56fcba5b5e35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-62732f3d-0060-4462-86c3-56fcba5b5e35" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-62732f3d-0060-4462-86c3-56fcba5b5e35" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleting offline snapshot 62732f3d-0060-4462-86c3-56fcba5b5e35 of volume 31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] snapshot_file for this snap is: volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6133aed4-9fc1-4a32-9f6c-5bb21a6e3b8f]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:54 devstack sudo[129668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 Jun 23 14:08:54 devstack sudo[129627]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:54 devstack sudo[129668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f.7bd3026b-5fde-4f99-9dcb-6ca215c819eb" returned: 0 in 1.311s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-7bd3026b-5fde-4f99-9dcb-6ca215c819eb" released by "_delete_snapshot" :: held 4.450s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" released by "delete_snapshot" :: held 4.480s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['bb905ae4-c813-447f-9b45-de7de0edcb59', '1f94294d-04ee-44fd-8688-5fad26258221', '30e92e1b-5de0-4868-a589-ecc078eee68d', '7723a567-0328-4829-9e6a-a6978288fcf5'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Delete snapshot completed successfully. Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8b3157ea-db84-41ad-9c3a-7bd523108770 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-7bd3026b-5fde-4f99-9dcb-6ca215c819eb-delete_snapshot" released by "delete_snapshot" :: held 4.801s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:54 devstack sudo[129649]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.157s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleted volume successfully. Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6900396b-aa10-4a97-937b-327bfdfd863e tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-611ad06c-9b13-4c71-9f8d-b99f9f25549e-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:54 devstack sudo[129642]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" returned: 0 in 1.466s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:54 devstack sudo[129698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b 1G Jun 23 14:08:54 devstack sudo[129698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:55 devstack sudo[129668]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35" returned: 0 in 1.071s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fb6218-0226-41ed-9347-b7cee65ef9cf]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:55 devstack sudo[129713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 Jun 23 14:08:55 devstack sudo[129713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (9e33060c-ad9d-4aec-8589-a2b8e9bbab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ade0b8-a9ba-4ebb-bc98-8145153f5307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ade0b8-a9ba-4ebb-bc98-8145153f5307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1485170783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9df6770-5ae4-423f-9937-a4887318ff1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:56Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2302dab5-43ae-40db-8c24-168704eb31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2302dab5-43ae-40db-8c24-168704eb31ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65df7a8-65c8-47bd-829e-678a9836afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65df7a8-65c8-47bd-829e-678a9836afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9df6770-5ae4-423f-9937-a4887318ff1e', 'volume_name': 'volume-c9df6770-5ae4-423f-9937-a4887318ff1e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc5927a-c52d-46b3-bcc5-9580929a2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc5927a-c52d-46b3-bcc5-9580929a2985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47a93a2-54b9-4c06-b1c9-a86585cc5855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:55 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Volume c9df6770-5ae4-423f-9937-a4887318ff1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9df6770-5ae4-423f-9937-a4887318ff1e', 'volume_size': 1} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:55 devstack sudo[129698]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b 1G" returned: 0 in 1.193s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:55 devstack sudo[129749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b Jun 23 14:08:55 devstack sudo[129749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:56 devstack sudo[129713]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" returned: 0 in 0.982s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:56 devstack sudo[129754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 Jun 23 14:08:56 devstack sudo[129754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:56 devstack sudo[129749]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" returned: 0 in 0.879s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:56 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:08:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:56 devstack sudo[129784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b Jun 23 14:08:56 devstack sudo[129784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:56 devstack sudo[129754]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35" returned: 0 in 0.904s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:57 devstack sudo[129792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35 Jun 23 14:08:57 devstack sudo[129792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:57 devstack sudo[129784]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" returned: 0 in 0.794s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:57 devstack sudo[129818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info Jun 23 14:08:57 devstack sudo[129818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:57 devstack sudo[129792]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0.62732f3d-0060-4462-86c3-56fcba5b5e35" returned: 0 in 0.774s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-62732f3d-0060-4462-86c3-56fcba5b5e35" released by "_delete_snapshot" :: held 3.906s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" released by "delete_snapshot" :: held 3.946s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['dac54a25-2927-411f-a8a4-e089871fa75d', '9489d096-ce10-4356-bd39-e2977c3e3cb2', 'dad75b8a-d84f-486e-b0dd-d40806dad81f', '74fd5c71-fdf3-43f0-acf2-e4e7b6faf0e8'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Delete snapshot completed successfully. Jun 23 14:08:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d91b9ea2-7447-429a-84d3-6a9e4e3ed631 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-62732f3d-0060-4462-86c3-56fcba5b5e35-delete_snapshot" released by "delete_snapshot" :: held 4.153s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "cinder-quobyte-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" acquired by "delete_volume" :: waited 0.038s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238c7ae-a84d-4386-ba72-9967a7692eec]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:58 devstack sudo[129839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 Jun 23 14:08:58 devstack sudo[129839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:58 devstack sudo[129818]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info" returned: 0 in 0.868s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:58 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:08:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:58 devstack sudo[129847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info Jun 23 14:08:58 devstack sudo[129847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:59 devstack sudo[129839]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:59 devstack sudo[129847]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" returned: 0 in 0.914s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.info" returned: 0 in 0.742s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:59 devstack sudo[129878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0 Jun 23 14:08:59 devstack sudo[129878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.064s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.495s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1485170783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9df6770-5ae4-423f-9937-a4887318ff1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:56Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Creating volume c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:59 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:59 devstack sudo[129880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e 1073741824 Jun 23 14:08:59 devstack sudo[129880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:59 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-00dc16d0-c572-4848-aeeb-3dfbf13f8aff tempest-GroupSnapshotsTest-598976176 None] group_snapshot d660d51b-dee3-40fa-80b9-35751960797d: created successfully Jun 23 14:08:59 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] group_snapshot d660d51b-dee3-40fa-80b9-35751960797d: deleting Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] group_snapshot d660d51b-dee3-40fa-80b9-35751960797d: deleting {{(pid=93689) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:59 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Deleting offline snapshot 5f7d56b8-48c5-4bd0-96ac-97a383f1d83b of volume a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] snapshot_file for this snap is: volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[76066006-b1c1-46df-b26c-312928f0ac6b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:00 devstack sudo[129878]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" returned: 0 in 0.927s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-quobyte-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0" released by "delete_volume" :: held 1.923s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:00 devstack sudo[129904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b Jun 23 14:09:00 devstack sudo[129904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Created reservations ['5c2004d9-b9c9-4ef8-9318-8480e048b150', '0805f305-e19a-4380-9f98-e34f3b44d09a', 'b6edcea4-4918-4acf-9a7e-517220cdf6f1', 'f0599894-b0a0-4e59-ad0d-44023f9e6730'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:00 devstack sudo[129924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:00 devstack sudo[129924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:00 devstack sudo[129880]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e 1073741824" returned: 0 in 1.406s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:00 devstack sudo[129938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:00 devstack sudo[129938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:01 devstack sudo[129924]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.115s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:01 devstack sudo[129904]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:01 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Deleted volume successfully. Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" returned: 0 in 1.502s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-31f9d407-8a5c-4dcc-a534-2c54867f2360 tempest-CreateVolumesFromSnapshotTest-1397459358 None] Lock "cinder-31ed49ed-f6ed-45a3-a0a2-e1787eae19e0-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c150c9f6-a335-454e-9842-a8f21445e9e4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:01 devstack sudo[129968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 Jun 23 14:09:01 devstack sudo[129968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:01 devstack sudo[129938]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 1.148s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] <== create_volume: return (2654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.666s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47a93a2-54b9-4c06-b1c9-a86585cc5855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9df6770-5ae4-423f-9937-a4887318ff1e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb26634f-87ec-4fdc-9089-ad17521c0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:02 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Volume volume-c9df6770-5ae4-423f-9937-a4887318ff1e (c9df6770-5ae4-423f-9937-a4887318ff1e): created successfully Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb26634f-87ec-4fdc-9089-ad17521c0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (9e33060c-ad9d-4aec-8589-a2b8e9bbab89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-31e954b7-bb68-4aae-afaf-ec9e3d6c3b97 tempest-VolumesSnapshotTestJSON-8168811 None] Created volume successfully. Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Creating offline snapshot 5ce4306f-f229-43b0-b27c-e7780a6aee95 of volume c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9507a14-98ad-4a74-94ac-593149f1d5c2]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:02 devstack sudo[129998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:02 devstack sudo[129998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:02 devstack sudo[129968]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" returned: 0 in 1.228s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:02 devstack sudo[130012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b Jun 23 14:09:02 devstack sudo[130012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:03 devstack sudo[129998]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 1.085s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:03 devstack sudo[130041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 1G Jun 23 14:09:03 devstack sudo[130041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:03 devstack sudo[130012]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" returned: 0 in 1.140s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:04 devstack sudo[130056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b Jun 23 14:09:04 devstack sudo[130056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:04 devstack sudo[130041]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 1G" returned: 0 in 1.155s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9df6770-5ae4-423f-9937-a4887318ff1e -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:04 devstack sudo[130089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9df6770-5ae4-423f-9937-a4887318ff1e -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 Jun 23 14:09:04 devstack sudo[130089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:04 devstack sudo[130056]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7.5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" returned: 0 in 0.958s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-5f7d56b8-48c5-4bd0-96ac-97a383f1d83b" released by "_delete_snapshot" :: held 5.026s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" released by "delete_snapshot" :: held 5.061s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:05 devstack cinder-volume[93689]: WARNING cinder.quota [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1022535224 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1022535224, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:09:05 devstack cinder-volume[93689]: WARNING cinder.quota [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1022535224 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1022535224, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:09:05 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] Created reservations ['0d816e88-b06d-4123-b9bc-af952e990e18', 'f949c3f7-8167-405c-95c1-aa396d868491', 'e571ff93-837c-4d57-b351-4dfd174d2950', '0c4b9a60-659e-49d7-bd68-cc4511b219ad'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:05 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5763bd83-29f4-419d-aba9-952f18223aea tempest-GroupSnapshotsTest-598976176 None] group_snapshot d660d51b-dee3-40fa-80b9-35751960797d: deleted successfully Jun 23 14:09:05 devstack sudo[130089]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9df6770-5ae4-423f-9937-a4887318ff1e -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95" returned: 0 in 0.895s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:05 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 is being set with open permissions: ugo+rw Jun 23 14:09:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:05 devstack sudo[130128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 Jun 23 14:09:05 devstack sudo[130128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "cinder-quobyte-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30b41d4-6ebd-4a28-b793-cec139deca9a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:06 devstack sudo[130141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 Jun 23 14:09:06 devstack sudo[130141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:06 devstack sudo[130128]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95" returned: 0 in 0.903s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:06 devstack sudo[130162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info Jun 23 14:09:06 devstack sudo[130162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:07 devstack sudo[130141]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" returned: 0 in 0.975s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:07 devstack sudo[130180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7 Jun 23 14:09:07 devstack sudo[130180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:07 devstack sudo[130162]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info" returned: 0 in 1.248s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:07 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info is being set with open permissions: ugo+rw Jun 23 14:09:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:07 devstack sudo[130208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info Jun 23 14:09:07 devstack sudo[130208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:07 devstack sudo[130180]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" returned: 0 in 0.942s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Lock "cinder-quobyte-a1a41269-2763-4ec3-9bd0-6d303a2efbd7" released by "delete_volume" :: held 2.038s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Created reservations ['6e5acd7a-f1d5-474d-ae37-119c9286e22c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:08 devstack cinder-volume[93689]: WARNING cinder.quota [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1022535224 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1022535224, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Created reservations ['f789aef6-b1a8-4e93-a14b-89b030e8a226', '3c9782ce-38fb-4542-95c5-ed04f1d80876', '84fb9212-da16-42d5-917f-3b264ecbd611', '5801ea81-9e31-4e5b-ba24-58fb74fd499e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:08 devstack sudo[130225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:08 devstack sudo[130225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:08 devstack sudo[130208]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.info" returned: 0 in 1.086s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.519s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Flow 'volume_create_manager' (25fbc8a4-ec0f-4de8-91f9-ec2047306db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7505f04-37aa-498c-aa95-3c0cf3e98296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-38e4792d-5bb1-4b06-9d44-3bfef4bb193f tempest-VolumesSnapshotTestJSON-8168811 None] Create snapshot completed successfully Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7505f04-37aa-498c-aa95-3c0cf3e98296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151e078f-c370-484b-9911-ec64af6da480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630f7c2f1804927a37250baec7df58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:09Z,use_quota=True,user_id='925b3d4a81e345c080c5c2365691c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acfccdf-6deb-4297-a57c-f4f843ec9958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acfccdf-6deb-4297-a57c-f4f843ec9958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc57931c-4a1c-4db1-9990-9839d485b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:09:09 devstack sudo[130225]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.034s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:09 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-bcf7e235-1301-4ba2-8946-74eddf9ed2d1 tempest-GroupSnapshotsTest-598976176 None] Delete group completed successfully. Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc57931c-4a1c-4db1-9990-9839d485b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '151e078f-c370-484b-9911-ec64af6da480', 'volume_name': 'volume-151e078f-c370-484b-9911-ec64af6da480', 'volume_size': 1, 'image_id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0dcde8fc71bda7937a1bcdfa9245c702', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4630f7c2f1804927a37250baec7df58d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76bfc8536191147078a2dcded55d66c69964437ed3ddc160db1e11450d931a47c244daeff65ee237fa4a64abd6cfb7b46e44eec675bafc22640c99861e6f59b2', 'id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'created_at': datetime.datetime(2026, 6, 23, 12, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 9, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c/file', 'properties': {}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd22da4-0741-481d-b3f7-7264ba123644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd22da4-0741-481d-b3f7-7264ba123644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4e2fbc-2a07-4bab-a9f0-e7f9676521a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:10 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Volume 151e078f-c370-484b-9911-ec64af6da480: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-151e078f-c370-484b-9911-ec64af6da480', 'volume_size': 1, 'image_id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0dcde8fc71bda7937a1bcdfa9245c702', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4630f7c2f1804927a37250baec7df58d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76bfc8536191147078a2dcded55d66c69964437ed3ddc160db1e11450d931a47c244daeff65ee237fa4a64abd6cfb7b46e44eec675bafc22640c99861e6f59b2', 'id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'created_at': datetime.datetime(2026, 6, 23, 12, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 9, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c/file', 'properties': {}}, 'image_service': } Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Trying to clone 151e078f-c370-484b-9911-ec64af6da480 from image b2f93c7d-2ef0-4da1-96bc-621eeebaf98c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:09:10 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[961efa35-59da-4569-bbd9-21c32f6aaa1b]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:10 devstack sudo[130292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD Jun 23 14:09:10 devstack sudo[130292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:10 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (9170992d-a84e-4efd-a114-cf6233a6c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6604b96e-a118-404f-82f5-e5236694c997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6604b96e-a118-404f-82f5-e5236694c997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1921935007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3df86c-ae60-45ec-b989-fa5bfac8215d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5ce4306f-f229-43b0-b27c-e7780a6aee95,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:11Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a96d260-f87a-41a0-9834-511cedb5d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a96d260-f87a-41a0-9834-511cedb5d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d7d35a-5fb4-41a2-be82-ea85aba17583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d7d35a-5fb4-41a2-be82-ea85aba17583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb3df86c-ae60-45ec-b989-fa5bfac8215d', 'volume_name': 'volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d', 'volume_size': 2, 'snapshot_id': '5ce4306f-f229-43b0-b27c-e7780a6aee95'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07e403e-1b65-42ea-92dc-5088281684b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07e403e-1b65-42ea-92dc-5088281684b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5d7114-a46f-499c-b660-b82e7288f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Volume cb3df86c-ae60-45ec-b989-fa5bfac8215d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d', 'volume_size': 2, 'snapshot_id': '5ce4306f-f229-43b0-b27c-e7780a6aee95'} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-5ce4306f-f229-43b0-b27c-e7780a6aee95-cb3df86c-ae60-45ec-b989-fa5bfac8215d" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-5ce4306f-f229-43b0-b27c-e7780a6aee95-cb3df86c-ae60-45ec-b989-fa5bfac8215d" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Creating volume cb3df86c-ae60-45ec-b989-fa5bfac8215d from snapshot 5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-cb3df86c-ae60-45ec-b989-fa5bfac8215d" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-cb3df86c-ae60-45ec-b989-fa5bfac8215d" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] snapshot: 5ce4306f-f229-43b0-b27c-e7780a6aee95, volume: cb3df86c-ae60-45ec-b989-fa5bfac8215d, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3496466-d74b-44e2-838d-a40a74fc430c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:11 devstack sudo[130321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 Jun 23 14:09:11 devstack sudo[130321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:11 devstack sudo[130292]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD" returned: 0 in 1.316s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:12 devstack sudo[130337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD Jun 23 14:09:12 devstack sudo[130337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:12 devstack sudo[130321]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95" returned: 0 in 1.272s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9df6770-5ae4-423f-9937-a4887318ff1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:09:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:09:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:09:12 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d2bda1-6e76-42f3-b2d3-be90d1fb8ac9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:12 devstack sudo[130370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:12 devstack sudo[130370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:13 devstack sudo[130337]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD" returned: 1 in 1.326s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:13 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Temporary image b2f93c7d-2ef0-4da1-96bc-621eeebaf98c is fetched for user 925b3d4a81e345c080c5c2365691c435. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:09:13 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9d5834-a136-4d7c-96d9-28f7623d2c1d]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:13 devstack sudo[130390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD Jun 23 14:09:13 devstack sudo[130390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:14 devstack sudo[130390]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD" returned: 0 in 1.085s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:14 devstack sudo[130370]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 1.604s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:14 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:09:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:14 devstack sudo[130431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d Jun 23 14:09:14 devstack sudo[130431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:14 devstack sudo[130430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD Jun 23 14:09:14 devstack sudo[130430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:15 devstack sudo[130430]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD" returned: 1 in 1.088s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:21 devstack sudo[130431]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d" returned: 0 in 6.868s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f2564-ca99-4661-856b-b9bc19aafe72]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:21 devstack sudo[130653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:21 devstack sudo[130653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8e071fc6-1aa6-4656-a320-29b5d5af2826 tempest-GroupSnapshotsV319Test-530947047 None] Group tempest-GroupSnapshotsV319Test-Group-383488771: creating Jun 23 14:09:21 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Flow 'volume_create_manager' (302a36a0-e6d1-44c2-b5f4-0d174afc8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad49fc04-1f22-4838-8a68-48cbfd73418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad49fc04-1f22-4838-8a68-48cbfd73418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-868788862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5055f01-88bf-47c1-8612-4c8b7389ce86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6e14bfb74b4b3aad429a94d8d1e2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:22Z,use_quota=True,user_id='33b1542b490340de97efbd7c8192dc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff26037-46be-4f72-b3a1-2dde73aa125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff26037-46be-4f72-b3a1-2dde73aa125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871ba8e1-857b-47f4-9aa4-a317e63dde58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871ba8e1-857b-47f4-9aa4-a317e63dde58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5055f01-88bf-47c1-8612-4c8b7389ce86', 'volume_name': 'volume-c5055f01-88bf-47c1-8612-4c8b7389ce86', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e2e75f-0b7d-4f2d-bdc0-20a3c96c2d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e2e75f-0b7d-4f2d-bdc0-20a3c96c2d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0744de71-3634-4f39-bf96-9509d2e91a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Volume c5055f01-88bf-47c1-8612-4c8b7389ce86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5055f01-88bf-47c1-8612-4c8b7389ce86', 'volume_size': 1} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8e071fc6-1aa6-4656-a320-29b5d5af2826 tempest-GroupSnapshotsV319Test-530947047 None] Group tempest-GroupSnapshotsV319Test-Group-383488771: created successfully Jun 23 14:09:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8e071fc6-1aa6-4656-a320-29b5d5af2826 tempest-GroupSnapshotsV319Test-530947047 None] Create group completed successfully. Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:22 devstack sudo[130653]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Flow 'volume_create_manager' (669780d8-34b4-40d3-b48a-cbcf77b60644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a518701-be6d-4446-8b99-1cdffcdd6eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 1.200s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:09:22 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Converted 1024.00 MB image at 149.08 MB/s Jun 23 14:09:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d is being set with open permissions: ugo+rw Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a518701-be6d-4446-8b99-1cdffcdd6eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-929022010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9cc84f-d9a1-4743-81c4-66e529afba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6e14bfb74b4b3aad429a94d8d1e2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:22Z,use_quota=True,user_id='33b1542b490340de97efbd7c8192dc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack sudo[130695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d Jun 23 14:09:22 devstack sudo[130695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcf6be2-178d-4ff9-9d72-cc808b0ceaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dcf6be2-178d-4ff9-9d72-cc808b0ceaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8307c41-2e32-4023-b57c-dfb5fc0ce6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8307c41-2e32-4023-b57c-dfb5fc0ce6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9cc84f-d9a1-4743-81c4-66e529afba73', 'volume_name': 'volume-6d9cc84f-d9a1-4743-81c4-66e529afba73', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c880e-3aaf-4b85-b187-33ef531aa023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c880e-3aaf-4b85-b187-33ef531aa023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c6abea-faa3-46db-b0d7-dc6f79abbcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:22 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Volume 6d9cc84f-d9a1-4743-81c4-66e529afba73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9cc84f-d9a1-4743-81c4-66e529afba73', 'volume_size': 1} Jun 23 14:09:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:23 devstack sudo[130695]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d" returned: 0 in 0.775s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-cb3df86c-ae60-45ec-b989-fa5bfac8215d" released by "_copy_volume_from_snapshot" :: held 11.879s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-5ce4306f-f229-43b0-b27c-e7780a6aee95-cb3df86c-ae60-45ec-b989-fa5bfac8215d" released by "_create_volume_from_snapshot" :: held 11.948s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.836s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151e078f-c370-484b-9911-ec64af6da480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630f7c2f1804927a37250baec7df58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:09Z,use_quota=True,user_id='925b3d4a81e345c080c5c2365691c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Creating volume 151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:23 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:23 devstack sudo[130722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 1073741824 Jun 23 14:09:23 devstack sudo[130722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5d7114-a46f-499c-b660-b82e7288f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d', 'volume_size': 2, 'snapshot_id': '5ce4306f-f229-43b0-b27c-e7780a6aee95'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d603186-dcc2-4f33-a0ec-63a3c944afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Volume volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d (cb3df86c-ae60-45ec-b989-fa5bfac8215d): created successfully Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d603186-dcc2-4f33-a0ec-63a3c944afde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (9170992d-a84e-4efd-a114-cf6233a6c78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d66f9fa9-6d2c-495d-8fb0-232f2581dd1c tempest-VolumesSnapshotTestJSON-8168811 None] Created volume successfully. Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Flow 'volume_create_manager' (de29b8f7-ddf3-4707-978c-c46e8d4caf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13201dc-9022-4bab-a749-2a1e76e32dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13201dc-9022-4bab-a749-2a1e76e32dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721207279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1974e9e-1f52-4df6-89f5-699de3c0bef9,host='devstack@QuobyteHD#QuobyteHD',id=db96a54c-3f75-4764-9de3-8aa8429abb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0615b0213e244626811d8ab8a5314624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:24Z,use_quota=True,user_id='552a3a6c23c140ff8548599775770692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21774385-e3a7-46f7-9517-f94a02fe7987),volume_type_id=21774385-e3a7-46f7-9517-f94a02fe7987)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d62f69-99b8-4815-8dd5-1051d270ed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d62f69-99b8-4815-8dd5-1051d270ed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b46a01d-2ef9-42d0-bf18-b561a36be21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b46a01d-2ef9-42d0-bf18-b561a36be21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db96a54c-3f75-4764-9de3-8aa8429abb85', 'volume_name': 'volume-db96a54c-3f75-4764-9de3-8aa8429abb85', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edaf3cf6-eb25-4373-baec-658f24b898f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edaf3cf6-eb25-4373-baec-658f24b898f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3491103-65cf-4ade-abd4-1b823f8277ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Volume db96a54c-3f75-4764-9de3-8aa8429abb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db96a54c-3f75-4764-9de3-8aa8429abb85', 'volume_size': 1} Jun 23 14:09:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-cb3df86c-ae60-45ec-b989-fa5bfac8215d-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-cb3df86c-ae60-45ec-b989-fa5bfac8215d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-cb3df86c-ae60-45ec-b989-fa5bfac8215d" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-cb3df86c-ae60-45ec-b989-fa5bfac8215d" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793505e-8642-46e2-8284-f73c71742e21]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:24 devstack sudo[130757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d Jun 23 14:09:24 devstack sudo[130757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:24 devstack sudo[130722]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 1073741824" returned: 0 in 1.249s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:24 devstack sudo[130769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:24 devstack sudo[130769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:25 devstack sudo[130757]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d" returned: 0 in 0.973s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:25 devstack sudo[130796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d Jun 23 14:09:25 devstack sudo[130796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:25 devstack sudo[130769]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 0 in 0.788s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.311s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-868788862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5055f01-88bf-47c1-8612-4c8b7389ce86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6e14bfb74b4b3aad429a94d8d1e2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:22Z,use_quota=True,user_id='33b1542b490340de97efbd7c8192dc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Creating volume c5055f01-88bf-47c1-8612-4c8b7389ce86 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:25 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:25 devstack sudo[130802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 1073741824 Jun 23 14:09:25 devstack sudo[130802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Attempting download of b2f93c7d-2ef0-4da1-96bc-621eeebaf98c ((None, [{'url': 'file:///opt/stack/data/glance/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'metadata': {}}])) to volume 151e078f-c370-484b-9911-ec64af6da480. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[99728e09-cab6-4aac-a2b8-b2dce33af240]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:25 devstack sudo[130807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14 Jun 23 14:09:25 devstack sudo[130807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:26 devstack sudo[130796]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-cb3df86c-ae60-45ec-b989-fa5bfac8215d" returned: 0 in 0.892s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-cb3df86c-ae60-45ec-b989-fa5bfac8215d" released by "delete_volume" :: held 1.937s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['3db1c5d2-aea7-431e-9a68-8e324479a925', 'bbcc9a02-6eba-45af-ba12-7fc8db1b05f6', '70fa03d3-205f-4449-9c4e-bb0245a187ce', 'de9efb89-69c8-4c12-90a3-ffcd39f11b07'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:26 devstack sudo[130841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:26 devstack sudo[130841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-5ce4306f-f229-43b0-b27c-e7780a6aee95-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-5ce4306f-f229-43b0-b27c-e7780a6aee95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-c9df6770-5ae4-423f-9937-a4887318ff1e" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:26 devstack sudo[130807]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14" returned: 0 in 1.104s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:26 devstack sudo[130802]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-c9df6770-5ae4-423f-9937-a4887318ff1e" acquired by "delete_snapshot" :: waited 0.073s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-5ce4306f-f229-43b0-b27c-e7780a6aee95" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 1073741824" returned: 0 in 1.261s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-5ce4306f-f229-43b0-b27c-e7780a6aee95" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Deleting offline snapshot 5ce4306f-f229-43b0-b27c-e7780a6aee95 of volume c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] snapshot_file for this snap is: volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e0e337-d9b0-4a92-acd9-3e3ca3f2b023]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:26 devstack sudo[130853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14 Jun 23 14:09:26 devstack sudo[130853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:26 devstack sudo[130863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 Jun 23 14:09:26 devstack sudo[130863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:26 devstack sudo[130860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 Jun 23 14:09:26 devstack sudo[130860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:27 devstack sudo[130841]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.944s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Deleted volume successfully. Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5ec90dd-5a65-4170-b291-54bc2e3659da tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-cb3df86c-ae60-45ec-b989-fa5bfac8215d-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:27 devstack sudo[130863]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86" returned: 0 in 0.997s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.284s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-929022010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9cc84f-d9a1-4743-81c4-66e529afba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e6e14bfb74b4b3aad429a94d8d1e2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:22Z,use_quota=True,user_id='33b1542b490340de97efbd7c8192dc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Creating volume 6d9cc84f-d9a1-4743-81c4-66e529afba73 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:27 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:27 devstack sudo[130901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 1073741824 Jun 23 14:09:27 devstack sudo[130901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0744de71-3634-4f39-bf96-9509d2e91a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5055f01-88bf-47c1-8612-4c8b7389ce86', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b93ec0-80e3-40c0-9802-6da099e1b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:27 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Volume volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 (c5055f01-88bf-47c1-8612-4c8b7389ce86): created successfully Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b93ec0-80e3-40c0-9802-6da099e1b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:27 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Flow 'volume_create_manager' (302a36a0-e6d1-44c2-b5f4-0d174afc8690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-be633702-19bc-4fec-b79a-169d5aa3a0b0 tempest-TestServerVolumeAttachmentScenario-850909200 None] Created volume successfully. Jun 23 14:09:28 devstack sudo[130853]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14" returned: 1 in 1.427s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_d3ogdk14' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[de69f669-f0af-48c8-a952-5194f26a4686]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:28 devstack sudo[130860]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95" returned: 0 in 1.398s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9df6770-5ae4-423f-9937-a4887318ff1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c85f7-419b-4054-9bfb-c18810ac5f31]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:28 devstack sudo[130911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD Jun 23 14:09:28 devstack sudo[130911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:28 devstack sudo[130918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:28 devstack sudo[130918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:28 devstack sudo[130911]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:29 devstack sudo[130901]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 1073741824" returned: 0 in 1.229s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:29 devstack sudo[130950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD Jun 23 14:09:29 devstack sudo[130950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:29 devstack sudo[130918]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 0.932s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:29 devstack sudo[130959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 Jun 23 14:09:29 devstack sudo[130959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:29 devstack sudo[130960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 Jun 23 14:09:29 devstack sudo[130960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:29 devstack sudo[130950]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD" returned: 1 in 0.996s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:29 devstack sudo[130959]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] b2f93c7d-2ef0-4da1-96bc-621eeebaf98c was raw, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73" returned: 0 in 0.846s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:29 devstack sudo[130995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:29 devstack sudo[130995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.198s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1974e9e-1f52-4df6-89f5-699de3c0bef9,created_at=2026-06-23T12:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-721207279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1974e9e-1f52-4df6-89f5-699de3c0bef9,host='devstack@QuobyteHD#QuobyteHD',id=db96a54c-3f75-4764-9de3-8aa8429abb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0615b0213e244626811d8ab8a5314624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:24Z,use_quota=True,user_id='552a3a6c23c140ff8548599775770692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21774385-e3a7-46f7-9517-f94a02fe7987),volume_type_id=21774385-e3a7-46f7-9517-f94a02fe7987)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Creating volume db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:30 devstack sudo[130960]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:30 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95" returned: 0 in 0.892s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60c6abea-faa3-46db-b0d7-dc6f79abbcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9cc84f-d9a1-4743-81c4-66e529afba73', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b329834c-3f2b-4bea-910f-0af524cb94de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:30 devstack sudo[131000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 1073741824 Jun 23 14:09:30 devstack sudo[131000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:30 devstack sudo[131001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95 Jun 23 14:09:30 devstack sudo[131001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Volume volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 (6d9cc84f-d9a1-4743-81c4-66e529afba73): created successfully Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b329834c-3f2b-4bea-910f-0af524cb94de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Flow 'volume_create_manager' (669780d8-34b4-40d3-b48a-cbcf77b60644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:30 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-43a4c20c-3d3d-48f2-bf63-0e351496dc34 tempest-TestServerVolumeAttachmentScenario-850909200 None] Created volume successfully. Jun 23 14:09:30 devstack sudo[131001]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e.5ce4306f-f229-43b0-b27c-e7780a6aee95" returned: 0 in 0.829s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:30 devstack sudo[130995]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 0 in 0.939s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2f93c7d-2ef0-4da1-96bc-621eeebaf98c_tunpmid3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:09:30 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-5ce4306f-f229-43b0-b27c-e7780a6aee95" released by "_delete_snapshot" :: held 4.206s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-c9df6770-5ae4-423f-9937-a4887318ff1e" released by "delete_snapshot" :: held 4.273s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:30 devstack sudo[131036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 1G Jun 23 14:09:30 devstack sudo[131036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['5f18542e-42a8-4107-a919-da9edd4ba74d', '18d41482-851f-49f7-b4d0-17267e9f8267', '68533a87-5e09-41eb-b9ea-41fdcd4c3411', '9ede8fac-5ac2-4cfc-b420-650b31192eb9'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Delete snapshot completed successfully. Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff3ae3e0-9596-45cd-a29d-26db2a11cd6f tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-5ce4306f-f229-43b0-b27c-e7780a6aee95-delete_snapshot" released by "delete_snapshot" :: held 4.507s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:31 devstack sudo[131000]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 1073741824" returned: 0 in 1.067s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:31 devstack sudo[131047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 Jun 23 14:09:31 devstack sudo[131047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:31 devstack sudo[131036]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 1G" returned: 0 in 0.833s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc373b63-4e6c-473a-b627-4e2235c94320]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:31 devstack sudo[131047]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85" returned: 0 in 0.727s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3491103-65cf-4ade-abd4-1b823f8277ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db96a54c-3f75-4764-9de3-8aa8429abb85', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:31 devstack sudo[131071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:31 devstack sudo[131071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42273cfa-f754-4cc2-9cc2-0b004847f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Volume volume-db96a54c-3f75-4764-9de3-8aa8429abb85 (db96a54c-3f75-4764-9de3-8aa8429abb85): created successfully Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42273cfa-f754-4cc2-9cc2-0b004847f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Flow 'volume_create_manager' (de29b8f7-ddf3-4707-978c-c46e8d4caf29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d276fab5-c5ba-4874-a8c2-4fdcb245e721 tempest-GroupSnapshotsV319Test-530947047 None] Created volume successfully. Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-c9df6770-5ae4-423f-9937-a4887318ff1e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-c9df6770-5ae4-423f-9937-a4887318ff1e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-c9df6770-5ae4-423f-9937-a4887318ff1e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-c9df6770-5ae4-423f-9937-a4887318ff1e" acquired by "delete_volume" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[13369e3d-4b0b-4113-99f5-bcc88c6b7475]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:32 devstack sudo[131085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:32 devstack sudo[131085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:32 devstack sudo[131093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:32 devstack sudo[131093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:32 devstack sudo[131071]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] GroupSnapshot 9d98bb26-8ab9-4124-9967-fc0c544b99e6: creating. Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 0 in 1.081s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Group snapshot 9d98bb26-8ab9-4124-9967-fc0c544b99e6: creating. {{(pid=93689) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Creating offline snapshot 2c57f812-4c0c-493c-ae72-4c0d04ec6246 of volume db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:09:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2c3b1-d572-4b92-88b1-55b69ead5c3e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:33 devstack sudo[131113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:33 devstack sudo[131113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:33 devstack sudo[131119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 Jun 23 14:09:33 devstack sudo[131119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:33 devstack sudo[131085]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 1.301s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:33 devstack sudo[131139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e Jun 23 14:09:33 devstack sudo[131139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:33 devstack sudo[131093]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.611s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:09:34 devstack sudo[131113]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 1 in 1.621s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Downloaded image b2f93c7d-2ef0-4da1-96bc-621eeebaf98c ((None, [{'url': 'file:///opt/stack/data/glance/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'metadata': {}}])) to volume 151e078f-c370-484b-9911-ec64af6da480 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Temporary image b2f93c7d-2ef0-4da1-96bc-621eeebaf98c for user 925b3d4a81e345c080c5c2365691c435 is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Marking volume 151e078f-c370-484b-9911-ec64af6da480 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:09:34 devstack sudo[131119]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85" returned: 0 in 1.488s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Copying metadata from image b2f93c7d-2ef0-4da1-96bc-621eeebaf98c to 151e078f-c370-484b-9911-ec64af6da480. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Creating volume glance metadata for volume 151e078f-c370-484b-9911-ec64af6da480 backed by image b2f93c7d-2ef0-4da1-96bc-621eeebaf98c with: {'image_id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0dcde8fc71bda7937a1bcdfa9245c702', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:09:34 devstack sudo[131182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 1G Jun 23 14:09:34 devstack sudo[131182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4e2fbc-2a07-4bab-a9f0-e7f9676521a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151e078f-c370-484b-9911-ec64af6da480', 'volume_size': 1, 'image_id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0dcde8fc71bda7937a1bcdfa9245c702', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4630f7c2f1804927a37250baec7df58d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76bfc8536191147078a2dcded55d66c69964437ed3ddc160db1e11450d931a47c244daeff65ee237fa4a64abd6cfb7b46e44eec675bafc22640c99861e6f59b2', 'id': 'b2f93c7d-2ef0-4da1-96bc-621eeebaf98c', 'created_at': datetime.datetime(2026, 6, 23, 12, 9, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 9, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2f93c7d-2ef0-4da1-96bc-621eeebaf98c/file', 'properties': {}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253cb745-261a-4d3d-830b-26447313036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Volume volume-151e078f-c370-484b-9911-ec64af6da480 (151e078f-c370-484b-9911-ec64af6da480): created successfully Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253cb745-261a-4d3d-830b-26447313036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Flow 'volume_create_manager' (25fbc8a4-ec0f-4de8-91f9-ec2047306db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:34 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a7e7bff0-5662-4f99-953e-17918a01d859 tempest-VolumeImageDependencyTests-586236869 None] Created volume successfully. Jun 23 14:09:34 devstack sudo[131139]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c9df6770-5ae4-423f-9937-a4887318ff1e" returned: 0 in 1.392s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-c9df6770-5ae4-423f-9937-a4887318ff1e" released by "delete_volume" :: held 2.762s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['14ef4a2d-f916-4d13-87f8-13167ad54df0', '363ae6e8-175c-4f2a-ad19-5f9862cfc5b0', '1e1e2cd4-4fc9-480b-be04-326502409488', '0ca3d7bd-a54d-43a4-bef7-f9cb9fed4218'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:35 devstack sudo[131221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:35 devstack sudo[131221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Acquiring lock "cinder-151e078f-c370-484b-9911-ec64af6da480-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Lock "cinder-151e078f-c370-484b-9911-ec64af6da480-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Acquiring lock "cinder-quobyte-151e078f-c370-484b-9911-ec64af6da480" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Lock "cinder-quobyte-151e078f-c370-484b-9911-ec64af6da480" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a2ce3-4ff9-475a-8b72-bc31eed0c64b]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:35 devstack sudo[131236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:35 devstack sudo[131236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:35 devstack sudo[131182]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 1G" returned: 0 in 1.470s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db96a54c-3f75-4764-9de3-8aa8429abb85 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:36 devstack sudo[131253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db96a54c-3f75-4764-9de3-8aa8429abb85 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 Jun 23 14:09:36 devstack sudo[131253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:36 devstack sudo[131221]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.177s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Deleted volume successfully. Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-fd2c0e41-203d-40f1-a1db-0d5a17534992 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-c9df6770-5ae4-423f-9937-a4887318ff1e-delete_volume" released by "delete_volume" :: held 4.371s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:36 devstack sudo[131236]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (ef266b31-22f9-4eba-ada4-b208457fed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125205c1-ed5e-4e4c-8c9f-dab9af45d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 0 in 1.232s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125205c1-ed5e-4e4c-8c9f-dab9af45d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-72729740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a09a95e-e9c4-42da-83be-b473fb2ea506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:37Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb514322-ce8e-4763-b450-ef3416939040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb514322-ce8e-4763-b450-ef3416939040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e79504-ec22-4328-b290-df12c337025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e79504-ec22-4328-b290-df12c337025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a09a95e-e9c4-42da-83be-b473fb2ea506', 'volume_name': 'volume-6a09a95e-e9c4-42da-83be-b473fb2ea506', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83114812-b377-49d1-8451-7068a56a48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83114812-b377-49d1-8451-7068a56a48da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bf5d5a-8b82-466c-bad8-4f1818f855d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Volume 6a09a95e-e9c4-42da-83be-b473fb2ea506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a09a95e-e9c4-42da-83be-b473fb2ea506', 'volume_size': 1} Jun 23 14:09:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:36 devstack sudo[131280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:36 devstack sudo[131280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:37 devstack sudo[131253]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db96a54c-3f75-4764-9de3-8aa8429abb85 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246" returned: 0 in 1.072s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:37 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:37 devstack sudo[131294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 Jun 23 14:09:37 devstack sudo[131294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:37 devstack sudo[131280]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 1 in 0.883s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:37 devstack sudo[131317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480 Jun 23 14:09:37 devstack sudo[131317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:37 devstack sudo[131294]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246" returned: 0 in 0.715s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:37 devstack sudo[131323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info Jun 23 14:09:37 devstack sudo[131323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:38 devstack sudo[131317]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-151e078f-c370-484b-9911-ec64af6da480" returned: 0 in 0.770s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Lock "cinder-quobyte-151e078f-c370-484b-9911-ec64af6da480" released by "delete_volume" :: held 2.976s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Created reservations ['dd5580bc-52f7-4ca4-9cb9-0034e5c7f982', '142a1d73-5432-46b9-b364-a803bcffe65d', '397748fc-99c8-4678-b124-57022c81cfb6', '0cab6b8a-6b64-4f9a-9a05-30e93aca2208'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:38 devstack sudo[131323]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info" returned: 0 in 0.763s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:38 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:38 devstack sudo[131351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:38 devstack sudo[131351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:38 devstack sudo[131357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:38 devstack sudo[131357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:39 devstack sudo[131351]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.info" returned: 0 in 0.838s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.484s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-72729740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a09a95e-e9c4-42da-83be-b473fb2ea506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:37Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Creating volume 6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:39 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:39 devstack sudo[131385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 1073741824 Jun 23 14:09:39 devstack sudo[131385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:39 devstack sudo[131357]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.852s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Deleted volume successfully. Jun 23 14:09:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-34c0ba31-8888-4c64-a5b1-e04afebff5ef tempest-VolumeImageDependencyTests-586236869 None] Lock "cinder-151e078f-c370-484b-9911-ec64af6da480-delete_volume" released by "delete_volume" :: held 4.197s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8283292d-594c-414b-b9c3-43baf1526cae tempest-GroupSnapshotsV319Test-530947047 None] group_snapshot 9d98bb26-8ab9-4124-9967-fc0c544b99e6: created successfully Jun 23 14:09:40 devstack sudo[131385]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 1073741824" returned: 0 in 1.146s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:40 devstack sudo[131429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:09:40 devstack sudo[131429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] group_snapshot 9d98bb26-8ab9-4124-9967-fc0c544b99e6: deleting Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] group_snapshot 9d98bb26-8ab9-4124-9967-fc0c544b99e6: deleting {{(pid=93689) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "cinder-quobyte-db96a54c-3f75-4764-9de3-8aa8429abb85" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Lock "cinder-quobyte-db96a54c-3f75-4764-9de3-8aa8429abb85" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "cinder-quobyte-2c57f812-4c0c-493c-ae72-4c0d04ec6246" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Lock "cinder-quobyte-2c57f812-4c0c-493c-ae72-4c0d04ec6246" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Deleting offline snapshot 2c57f812-4c0c-493c-ae72-4c0d04ec6246 of volume db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] snapshot_file for this snap is: volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a834e-fc5f-4a8c-abb4-592da97487b3]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:41 devstack sudo[131484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 Jun 23 14:09:41 devstack sudo[131484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:41 devstack sudo[131429]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 1.103s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bf5d5a-8b82-466c-bad8-4f1818f855d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a09a95e-e9c4-42da-83be-b473fb2ea506', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b49ff2-1a6f-4460-a973-270ade8b1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:41 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Volume volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 (6a09a95e-e9c4-42da-83be-b473fb2ea506): created successfully Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b49ff2-1a6f-4460-a973-270ade8b1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (ef266b31-22f9-4eba-ada4-b208457fed10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ab23029a-d0c9-44b3-a05c-325857ebd4de tempest-VolumesSnapshotTestJSON-8168811 None] Created volume successfully. Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Creating offline snapshot 732f2099-1250-4271-a905-ecf88309d2d4 of volume 6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cdafb-1b9c-47d8-8874-43e36f692e60]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:42 devstack sudo[131484]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246" returned: 0 in 1.278s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db96a54c-3f75-4764-9de3-8aa8429abb85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[df912a2e-264f-4be9-941c-b675aff49694]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:42 devstack sudo[131557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:09:42 devstack sudo[131557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:42 devstack sudo[131566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 Jun 23 14:09:42 devstack sudo[131566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:44 devstack sudo[131557]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 1.620s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:44 devstack sudo[131665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 1G Jun 23 14:09:44 devstack sudo[131665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:44 devstack sudo[131566]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85" returned: 0 in 1.951s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:44 devstack sudo[131682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 Jun 23 14:09:44 devstack sudo[131682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:45 devstack sudo[131665]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 1G" returned: 0 in 1.643s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:45 devstack sudo[131729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 Jun 23 14:09:45 devstack sudo[131729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:45 devstack sudo[131682]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246" returned: 0 in 1.383s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:45 devstack sudo[131737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246 Jun 23 14:09:45 devstack sudo[131737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:47 devstack sudo[131729]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4" returned: 0 in 1.300s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:47 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 is being set with open permissions: ugo+rw Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:47 devstack sudo[131737]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85.2c57f812-4c0c-493c-ae72-4c0d04ec6246" returned: 0 in 1.116s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:47 devstack sudo[131778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 Jun 23 14:09:47 devstack sudo[131778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Lock "cinder-quobyte-2c57f812-4c0c-493c-ae72-4c0d04ec6246" released by "_delete_snapshot" :: held 5.938s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Lock "cinder-quobyte-db96a54c-3f75-4764-9de3-8aa8429abb85" released by "delete_snapshot" :: held 6.007s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=153,cinder:SELECT=120,cinder:INSERT=37,cinder:DELETE=7 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=128,cinder:INSERT=36,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:09:47 devstack cinder-volume[93689]: WARNING cinder.quota [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1569805256 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1569805256, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:09:47 devstack cinder-volume[93689]: WARNING cinder.quota [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1569805256 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1569805256, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:09:47 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] Created reservations ['a0be258e-0f74-475e-9562-3235d62d6cbe', '9aa12c9d-9d08-4690-ab06-7119fe06bb93', '6c53cab3-74da-4a4e-99c9-cd6959ce51f8', '90e098f3-8187-44a2-98f1-d9eb180d367e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1e563c35-f637-49dc-aa66-542435dfcd8e tempest-GroupSnapshotsV319Test-530947047 None] group_snapshot 9d98bb26-8ab9-4124-9967-fc0c544b99e6: deleted successfully Jun 23 14:09:48 devstack sudo[131778]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4" returned: 0 in 0.992s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:48 devstack sudo[131811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info Jun 23 14:09:48 devstack sudo[131811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "cinder-quobyte-db96a54c-3f75-4764-9de3-8aa8429abb85" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Lock "cinder-quobyte-db96a54c-3f75-4764-9de3-8aa8429abb85" acquired by "delete_volume" :: waited 0.047s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7913fc9-0b03-4116-868a-bf93fbb5d96b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:48 devstack sudo[131828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 Jun 23 14:09:48 devstack sudo[131828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:49 devstack sudo[131811]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info" returned: 0 in 1.395s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:49 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info is being set with open permissions: ugo+rw Jun 23 14:09:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:49 devstack sudo[131859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info Jun 23 14:09:49 devstack sudo[131859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:49 devstack sudo[131828]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85" returned: 0 in 1.209s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:49 devstack sudo[131875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85 Jun 23 14:09:49 devstack sudo[131875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:50 devstack sudo[131875]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-db96a54c-3f75-4764-9de3-8aa8429abb85" returned: 0 in 1.026s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Lock "cinder-quobyte-db96a54c-3f75-4764-9de3-8aa8429abb85" released by "delete_volume" :: held 2.379s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:50 devstack sudo[131859]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.info" returned: 0 in 1.449s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.605s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-390ecf00-3678-4931-8dcd-31940dba7241 tempest-VolumesSnapshotTestJSON-8168811 None] Create snapshot completed successfully Jun 23 14:09:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Created reservations ['4c34ec52-befb-4c34-af5d-3886525fc72f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:51 devstack cinder-volume[93689]: WARNING cinder.quota [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1569805256 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1569805256, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Created reservations ['7f1db7c0-42aa-403d-b227-c0e1aa84e2bc', '30244d66-7714-4bff-a9b6-a854300ff89a', '91520960-d819-41f9-8d97-80359c8eb423', '3d5dea14-b6a3-4837-868d-9b96663d19ff'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:51 devstack sudo[131926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:09:51 devstack sudo[131926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (72292bbf-c48c-4fcb-a545-94b33b9e6883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d436f5ba-ca69-499d-93ef-a98ee59ddb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d436f5ba-ca69-499d-93ef-a98ee59ddb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-554798514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773862ab-43e5-42d4-aa3c-1a8ca3fc92d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9506ef1eb2a745e0ace5e95dd5244ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=732f2099-1250-4271-a905-ecf88309d2d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:52Z,use_quota=True,user_id='b7a1d1b60f4442a09bb07e03f21339e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462cbe0e-6e6e-4f9d-92d3-92e6d4d82a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462cbe0e-6e6e-4f9d-92d3-92e6d4d82a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0ff7c8-ad99-4a01-9d3d-042580a47d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:52 devstack sudo[131926]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0ff7c8-ad99-4a01-9d3d-042580a47d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '773862ab-43e5-42d4-aa3c-1a8ca3fc92d4', 'volume_name': 'volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4', 'volume_size': 1, 'snapshot_id': '732f2099-1250-4271-a905-ecf88309d2d4'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27abbd2d-5cad-4406-afc7-a8efbc454b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27abbd2d-5cad-4406-afc7-a8efbc454b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902ea4d9-9cc7-483f-adb9-14ed41de7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:52 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Volume 773862ab-43e5-42d4-aa3c-1a8ca3fc92d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4', 'volume_size': 1, 'snapshot_id': '732f2099-1250-4271-a905-ecf88309d2d4'} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.199s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-732f2099-1250-4271-a905-ecf88309d2d4-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:52 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d117fd73-9a30-4b43-b137-493100b174df tempest-GroupSnapshotsV319Test-530947047 None] Delete group completed successfully. Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-732f2099-1250-4271-a905-ecf88309d2d4-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Creating volume 773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 from snapshot 732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] snapshot: 732f2099-1250-4271-a905-ecf88309d2d4, volume: 773862ab-43e5-42d4-aa3c-1a8ca3fc92d4, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cad1d87-f3aa-4c55-9c2b-3076a59267a9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:52 devstack sudo[131969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 Jun 23 14:09:52 devstack sudo[131969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:54 devstack sudo[131969]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4" returned: 0 in 1.316s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a09a95e-e9c4-42da-83be-b473fb2ea506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:09:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:09:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:09:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8c6ff-6a18-48de-9e99-442c160c3b06]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:54 devstack sudo[132013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:09:54 devstack sudo[132013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:55 devstack sudo[132013]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 1.221s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:55 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:09:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:55 devstack sudo[132057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 Jun 23 14:09:55 devstack sudo[132057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:10:02 devstack sudo[132057]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" returned: 0 in 7.333s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:10:02 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92129f4-ab42-48e6-99cf-b7933e250dc5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:02 devstack sudo[132311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:10:02 devstack sudo[132311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-130a77fa-206b-454d-9394-2f9fc4c3fe11 tempest-GroupsV320Test-738578696 None] Group tempest-GroupsV320Test-Group-1455354309: creating Jun 23 14:10:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-130a77fa-206b-454d-9394-2f9fc4c3fe11 tempest-GroupsV320Test-738578696 None] Group tempest-GroupsV320Test-Group-1455354309: created successfully Jun 23 14:10:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-130a77fa-206b-454d-9394-2f9fc4c3fe11 tempest-GroupsV320Test-738578696 None] Create group completed successfully. Jun 23 14:10:04 devstack sudo[132311]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 1.430s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:10:04 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Converted 1024.00 MB image at 139.61 MB/s Jun 23 14:10:04 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 is being set with open permissions: ugo+rw Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:04 devstack sudo[132358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 Jun 23 14:10:04 devstack sudo[132358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:04 devstack sudo[132358]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" returned: 0 in 0.705s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" released by "_copy_volume_from_snapshot" :: held 12.169s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-732f2099-1250-4271-a905-ecf88309d2d4-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" released by "_create_volume_from_snapshot" :: held 12.217s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.260s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902ea4d9-9cc7-483f-adb9-14ed41de7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4', 'volume_size': 1, 'snapshot_id': '732f2099-1250-4271-a905-ecf88309d2d4'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddf1cd6-865e-4ab3-b51b-3780883ed5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Volume volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 (773862ab-43e5-42d4-aa3c-1a8ca3fc92d4): created successfully Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddf1cd6-865e-4ab3-b51b-3780883ed5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Flow 'volume_create_manager' (72292bbf-c48c-4fcb-a545-94b33b9e6883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7f58a589-0567-4ee6-a5a2-0e64a2b6b4aa tempest-VolumesSnapshotTestJSON-8168811 None] Created volume successfully. Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Created reservations ['d4e624d6-cffa-45d1-b7ce-db1af941f140'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:05 devstack sudo[132413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:05 devstack sudo[132413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b516793-7304-486a-9f4e-07c8af961324]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:06 devstack sudo[132424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 Jun 23 14:10:06 devstack sudo[132424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:06 devstack sudo[132413]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.156s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:06 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:06 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2fa40171-2073-4a66-8c74-0c7b67c4193b tempest-GroupsV320Test-738578696 None] Delete group completed successfully. Jun 23 14:10:07 devstack sudo[132424]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" returned: 0 in 1.265s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:07 devstack sudo[132471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4 Jun 23 14:10:07 devstack sudo[132471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:08 devstack sudo[132471]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" returned: 0 in 0.876s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4" released by "delete_volume" :: held 2.222s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['360d1b4f-7ed9-456d-b128-d9a6e6ecba11', '73f4246d-f023-44a0-80ae-034b6fb5de78', 'a4e793c3-bb22-4e21-aae1-c2dfc56607ad', '33c757dc-4b82-465a-9f57-0a2b2e5bc6fa'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:08 devstack sudo[132506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:08 devstack sudo[132506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:09 devstack sudo[132506]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.814s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Deleted volume successfully. Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6f826d73-e7a7-474a-b290-f730af6031aa tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-773862ab-43e5-42d4-aa3c-1a8ca3fc92d4-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-732f2099-1250-4271-a905-ecf88309d2d4-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-732f2099-1250-4271-a905-ecf88309d2d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-6a09a95e-e9c4-42da-83be-b473fb2ea506" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-6a09a95e-e9c4-42da-83be-b473fb2ea506" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-732f2099-1250-4271-a905-ecf88309d2d4" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-732f2099-1250-4271-a905-ecf88309d2d4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Deleting offline snapshot 732f2099-1250-4271-a905-ecf88309d2d4 of volume 6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] snapshot_file for this snap is: volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e61a0ad-2044-4c20-858c-7eac5e674b37]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:09 devstack sudo[132546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 Jun 23 14:10:09 devstack sudo[132546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:10 devstack sudo[132546]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4" returned: 0 in 1.045s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a09a95e-e9c4-42da-83be-b473fb2ea506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a779b6a1-f0fc-4462-863e-534ba8e3f0cb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:10 devstack sudo[132586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:10:10 devstack sudo[132586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:11 devstack sudo[132586]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 1.286s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:11 devstack sudo[132632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 Jun 23 14:10:11 devstack sudo[132632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:13 devstack sudo[132632]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4" returned: 0 in 1.431s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:13 devstack sudo[132681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4 Jun 23 14:10:13 devstack sudo[132681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:14 devstack sudo[132681]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506.732f2099-1250-4271-a905-ecf88309d2d4" returned: 0 in 1.444s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-732f2099-1250-4271-a905-ecf88309d2d4" released by "_delete_snapshot" :: held 5.390s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-6a09a95e-e9c4-42da-83be-b473fb2ea506" released by "delete_snapshot" :: held 5.425s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:14 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['f86617b3-7f34-4327-8932-7e6d01a3ac4f', 'c8cab4f9-d237-4b0e-a694-d26205aabce8', '1db08dd4-215e-4392-9028-74839461dbb6', '1be9203d-ccd4-4f24-bfef-9826ec9e16d7'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Delete snapshot completed successfully. Jun 23 14:10:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ccf0c1f7-89ec-4fce-8485-f2c3b7b08537 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-732f2099-1250-4271-a905-ecf88309d2d4-delete_snapshot" released by "delete_snapshot" :: held 5.655s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:15 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0b0458-b1d6-4667-a16d-32033a581dc8]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:15 devstack sudo[132750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 Jun 23 14:10:15 devstack sudo[132750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:16 devstack sudo[132750]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86" returned: 0 in 0.950s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-c5055f01-88bf-47c1-8612-4c8b7389ce86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '791cbd75-98a4-4484-8ecc-a9cbf65a365b', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:10:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-bfc6dd62-7cab-4c43-b395-7749238f8245 req-3741b36e-9471-438a-8d0c-b47cbb55dc3c tempest-TestServerVolumeAttachmentScenario-850909200 None] attachment_update completed successfully. Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-6a09a95e-e9c4-42da-83be-b473fb2ea506-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-6a09a95e-e9c4-42da-83be-b473fb2ea506-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-6a09a95e-e9c4-42da-83be-b473fb2ea506" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Flow 'volume_create_manager' (8ce6409c-4bbc-486d-8784-1b8118c8c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113dc986-5062-44a0-8847-c63177fc84b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-6a09a95e-e9c4-42da-83be-b473fb2ea506" acquired by "delete_volume" :: waited 0.071s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113dc986-5062-44a0-8847-c63177fc84b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-13711777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d240cb-7e13-4030-96e6-be8a20d88daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7021d54e63b943f3982e541477363e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:17Z,use_quota=True,user_id='f7af2187fc324155bc8108fba424c98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4564dfb1-632d-4a84-9088-871115327a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4564dfb1-632d-4a84-9088-871115327a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bebc861-7f3f-4e0b-8151-0e53f687bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bebc861-7f3f-4e0b-8151-0e53f687bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d240cb-7e13-4030-96e6-be8a20d88daa', 'volume_name': 'volume-82d240cb-7e13-4030-96e6-be8a20d88daa', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c55ef-47e7-46f7-a89b-f58765bda9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c55ef-47e7-46f7-a89b-f58765bda9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c196607-6dd4-408d-86dd-877afc0671e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Volume 82d240cb-7e13-4030-96e6-be8a20d88daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d240cb-7e13-4030-96e6-be8a20d88daa', 'volume_size': 1} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-13711777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d240cb-7e13-4030-96e6-be8a20d88daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7021d54e63b943f3982e541477363e85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:17Z,use_quota=True,user_id='f7af2187fc324155bc8108fba424c98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Creating volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:16 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c439fba-e98b-49a5-b285-e8c89ab356e8]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:16 devstack sudo[132852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa 1073741824 Jun 23 14:10:16 devstack sudo[132852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:17 devstack sudo[132854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:10:17 devstack sudo[132854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:17 devstack sudo[132854]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 0.868s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:17 devstack sudo[133228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506 Jun 23 14:10:17 devstack sudo[133228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:18 devstack sudo[132852]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa 1073741824" returned: 0 in 1.162s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:18 devstack sudo[133242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa Jun 23 14:10:18 devstack sudo[133242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Flow 'volume_create_manager' (db86edd4-450c-437e-864b-9f1be6f5ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a38cc8-db85-4e2a-b595-a18904d3e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a38cc8-db85-4e2a-b595-a18904d3e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-677814510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319ed14c-5e0c-405a-ac28-60e50ea87a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c313f2ce5dd84a61bc70d03b612d0c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:18Z,use_quota=True,user_id='9c2b01d897cf4d77a1ea01f36aef27fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a427c270-4d04-4237-89dc-894274eee0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a427c270-4d04-4237-89dc-894274eee0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ed5e35-a30c-4eac-9004-40eeca1da0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ed5e35-a30c-4eac-9004-40eeca1da0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319ed14c-5e0c-405a-ac28-60e50ea87a01', 'volume_name': 'volume-319ed14c-5e0c-405a-ac28-60e50ea87a01', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e59d8f-0e94-4a7f-a186-adf37cffa2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e59d8f-0e94-4a7f-a186-adf37cffa2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc60096-07d3-4e82-9736-c34a1301c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:18 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Volume 319ed14c-5e0c-405a-ac28-60e50ea87a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319ed14c-5e0c-405a-ac28-60e50ea87a01', 'volume_size': 1} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:18 devstack sudo[133228]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6a09a95e-e9c4-42da-83be-b473fb2ea506" returned: 0 in 0.770s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-6a09a95e-e9c4-42da-83be-b473fb2ea506" released by "delete_volume" :: held 1.785s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['8ffaf605-a5cb-4c85-85f5-609f51583929', 'bbe0f291-5ca8-4d86-b7f2-b3465f61423a', 'b625f7e0-c324-4ac3-bd1f-3831ea449c60', '02f1b995-8980-4c48-ae3c-4a71f3a78ee8'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:18 devstack sudo[133261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:18 devstack sudo[133261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:18 devstack sudo[133242]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa" returned: 0 in 0.766s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-677814510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319ed14c-5e0c-405a-ac28-60e50ea87a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c313f2ce5dd84a61bc70d03b612d0c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:18Z,use_quota=True,user_id='9c2b01d897cf4d77a1ea01f36aef27fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Creating volume 319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:18 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:18 devstack sudo[133272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 1073741824 Jun 23 14:10:18 devstack sudo[133272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c196607-6dd4-408d-86dd-877afc0671e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d240cb-7e13-4030-96e6-be8a20d88daa', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5129c1-e190-4ea9-bc6a-982dd97aec25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:19 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Volume volume-82d240cb-7e13-4030-96e6-be8a20d88daa (82d240cb-7e13-4030-96e6-be8a20d88daa): created successfully Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5129c1-e190-4ea9-bc6a-982dd97aec25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Flow 'volume_create_manager' (8ce6409c-4bbc-486d-8784-1b8118c8c72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:19 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-479a0fda-93f6-4238-a316-85b5893205c8 tempest-SnapshotsActionsTest-1611807228 None] Created volume successfully. Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "cinder-quobyte-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e206f3c-81be-4937-86e6-70b5821e5e5e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:19 devstack sudo[133281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f Jun 23 14:10:19 devstack sudo[133281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:19 devstack sudo[133261]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.831s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:19 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Deleted volume successfully. Jun 23 14:10:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b258fe4-8bed-4690-8fde-979481242bb6 tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-6a09a95e-e9c4-42da-83be-b473fb2ea506-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:20 devstack sudo[133272]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 1073741824" returned: 0 in 1.132s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:20 devstack sudo[133318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:20 devstack sudo[133318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:20 devstack sudo[133281]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" returned: 0 in 0.931s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:20 devstack sudo[133323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f Jun 23 14:10:20 devstack sudo[133323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:20 devstack sudo[133318]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 0.709s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.740s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc60096-07d3-4e82-9736-c34a1301c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319ed14c-5e0c-405a-ac28-60e50ea87a01', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafdabf3-9dcd-475c-a12c-9cb4a5b8bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:20 devstack sudo[133323]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Creating offline snapshot ed00b28c-e0f0-4a31-807b-cc434da448ae of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" returned: 0 in 0.694s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e2d73-932e-431c-86bc-8c38a8f2d6ae]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:20 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Volume volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 (319ed14c-5e0c-405a-ac28-60e50ea87a01): created successfully Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafdabf3-9dcd-475c-a12c-9cb4a5b8bb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Flow 'volume_create_manager' (db86edd4-450c-437e-864b-9f1be6f5ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-quobyte-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f" released by "delete_volume" :: held 1.740s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-af4d8321-32fc-4983-a244-2ce3a9e5c133 tempest-SnapshotDependencyTests-1755068704 None] Created volume successfully. Jun 23 14:10:20 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Created reservations ['677b5f7e-9023-4677-b7a4-4100192dd8fd', 'c8772d48-6135-4c5f-a9ab-d6364daed59c', '2108a319-60e5-4771-9c74-8a25fb61f5f5', '335aea4c-ff3c-4342-a1bf-451d393c87f8'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:20 devstack sudo[133348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa Jun 23 14:10:20 devstack sudo[133348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:21 devstack sudo[133353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:21 devstack sudo[133353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:21 devstack sudo[133353]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.862s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Deleted volume successfully. Jun 23 14:10:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4f2c5afb-0925-4dd4-836a-13725b17576e tempest-VolumesSnapshotTestJSON-8168811 None] Lock "cinder-a4d3c639-5b25-4fab-94d4-d14bb6a53d6f-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:22 devstack sudo[133348]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa" returned: 0 in 1.150s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:22 devstack sudo[133390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae 1G Jun 23 14:10:22 devstack sudo[133390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:23 devstack sudo[133390]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae 1G" returned: 0 in 1.070s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:23 devstack sudo[133429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:10:23 devstack sudo[133429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:23 devstack sudo[133429]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.810s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:23 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae is being set with open permissions: ugo+rw Jun 23 14:10:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:23 devstack sudo[133460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:10:23 devstack sudo[133460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:24 devstack sudo[133460]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.715s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:24 devstack sudo[133487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info Jun 23 14:10:24 devstack sudo[133487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:25 devstack sudo[133487]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info" returned: 0 in 0.780s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:25 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info is being set with open permissions: ugo+rw Jun 23 14:10:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:25 devstack sudo[133515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info Jun 23 14:10:25 devstack sudo[133515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:26 devstack sudo[133515]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.info" returned: 0 in 0.736s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.405s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.153s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Creating offline snapshot 5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 of volume 319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8fac0ec6-34e2-497a-a8ad-0c3e620fdc14 tempest-SnapshotsActionsTest-1611807228 None] Create snapshot completed successfully Jun 23 14:10:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd207a93-f0ce-4161-b650-833965a8e856]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:26 devstack sudo[133545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:26 devstack sudo[133545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:27 devstack sudo[133545]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 1.055s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:27 devstack sudo[133590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 1G Jun 23 14:10:27 devstack sudo[133590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:28 devstack sudo[133590]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 1G" returned: 0 in 0.905s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:28 devstack sudo[133624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 Jun 23 14:10:28 devstack sudo[133624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Flow 'volume_create_manager' (fed0b89b-7ec2-4328-95f0-8c609ccbfbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf024a76-41f4-4774-8ef8-3aa53c259c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf024a76-41f4-4774-8ef8-3aa53c259c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1084563702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c2a087-869b-4419-acbc-d62430502a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2d048789f94ace9a81fd5f0e65c056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:29Z,use_quota=True,user_id='99be82f801154715a20a32f6e7ee70bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eb98eb-1b77-4d99-885f-f4bfb812ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eb98eb-1b77-4d99-885f-f4bfb812ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a48946-4519-47f2-8b43-ba4a7e724085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a48946-4519-47f2-8b43-ba4a7e724085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c2a087-869b-4419-acbc-d62430502a74', 'volume_name': 'volume-47c2a087-869b-4419-acbc-d62430502a74', 'volume_size': 2}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8055b870-91c2-42b0-86f8-1ff95aa5522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8055b870-91c2-42b0-86f8-1ff95aa5522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0730dbc7-bfcd-4ec8-82de-8a83c984ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:28 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Volume 47c2a087-869b-4419-acbc-d62430502a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c2a087-869b-4419-acbc-d62430502a74', 'volume_size': 2} Jun 23 14:10:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:29 devstack sudo[133624]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" returned: 0 in 0.789s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:29 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 is being set with open permissions: ugo+rw Jun 23 14:10:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:29 devstack sudo[133653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 Jun 23 14:10:29 devstack sudo[133653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:29 devstack sudo[133653]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" returned: 0 in 0.685s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:29 devstack sudo[133677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info Jun 23 14:10:29 devstack sudo[133677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:30 devstack sudo[133677]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info" returned: 0 in 0.699s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:30 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info is being set with open permissions: ugo+rw Jun 23 14:10:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:30 devstack sudo[133701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info Jun 23 14:10:30 devstack sudo[133701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:31 devstack sudo[133701]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.info" returned: 0 in 0.679s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.948s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.904s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Creating offline snapshot 2d646542-4fff-4b7c-8cf4-a08be4232d1b of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e86e4ceb-1bb0-4ed9-bf58-5f75eac00093 tempest-SnapshotDependencyTests-1755068704 None] Create snapshot completed successfully Jun 23 14:10:31 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09607f-70c3-482f-a2ff-a197e1f8141f]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:31 devstack sudo[133728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:10:31 devstack sudo[133728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:32 devstack sudo[133728]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.863s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:32 devstack sudo[133757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b 1G Jun 23 14:10:32 devstack sudo[133757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:32 devstack sudo[133768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:32 devstack sudo[133768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Flow 'volume_create_manager' (ff14015c-d3fd-4006-8986-e0982cde0fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8106d2-8922-46cd-8a9e-23fe62ddd52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8106d2-8922-46cd-8a9e-23fe62ddd52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2a420d-6dff-4641-8529-113d56627cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c313f2ce5dd84a61bc70d03b612d0c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:32Z,use_quota=True,user_id='9c2b01d897cf4d77a1ea01f36aef27fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3de470-6a42-4eb1-909c-dbcfd5884835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3de470-6a42-4eb1-909c-dbcfd5884835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217455d6-6be1-4011-9cc8-8a8eaad28b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217455d6-6be1-4011-9cc8-8a8eaad28b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d2a420d-6dff-4641-8529-113d56627cf6', 'volume_name': 'volume-2d2a420d-6dff-4641-8529-113d56627cf6', 'volume_size': 1, 'snapshot_id': '5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073b5732-f3d9-43c7-a9d3-2fa7303a6486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073b5732-f3d9-43c7-a9d3-2fa7303a6486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d526df-4d40-4907-9ad3-8c34dec24366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Volume 2d2a420d-6dff-4641-8529-113d56627cf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d2a420d-6dff-4641-8529-113d56627cf6', 'volume_size': 1, 'snapshot_id': '5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67'} Jun 23 14:10:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:33 devstack sudo[133757]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b 1G" returned: 0 in 0.948s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:33 devstack sudo[133796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b Jun 23 14:10:33 devstack sudo[133796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:33 devstack sudo[133768]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.723s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:10:33 devstack sudo[133796]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b" returned: 0 in 0.776s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:33 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b is being set with open permissions: ugo+rw Jun 23 14:10:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:33 devstack sudo[133822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b Jun 23 14:10:33 devstack sudo[133822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:34 devstack sudo[133822]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b" returned: 0 in 0.704s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.401s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.274s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc580583-3ba3-448f-8ece-03ce6ca3cc40]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:34 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5a3b8fb4-4a19-4ba7-bf2c-8a95efbd2efb tempest-SnapshotsActionsTest-1611807228 None] Create snapshot completed successfully Jun 23 14:10:34 devstack sudo[133849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 Jun 23 14:10:34 devstack sudo[133849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-2d646542-4fff-4b7c-8cf4-a08be4232d1b-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-2d646542-4fff-4b7c-8cf4-a08be4232d1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-2d646542-4fff-4b7c-8cf4-a08be4232d1b" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-2d646542-4fff-4b7c-8cf4-a08be4232d1b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Deleting offline snapshot 2d646542-4fff-4b7c-8cf4-a08be4232d1b of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] snapshot_file for this snap is: volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a90a3d-568e-4dcf-8410-5aaafe49872a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:35 devstack sudo[133864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b Jun 23 14:10:35 devstack sudo[133864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:35 devstack sudo[133849]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73" returned: 0 in 0.812s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.627s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1084563702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c2a087-869b-4419-acbc-d62430502a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a2d048789f94ace9a81fd5f0e65c056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:29Z,use_quota=True,user_id='99be82f801154715a20a32f6e7ee70bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Creating volume 47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:35 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 2147483648 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:35 devstack sudo[133883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 2147483648 Jun 23 14:10:35 devstack sudo[133883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-6d9cc84f-d9a1-4743-81c4-66e529afba73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a13ccf24-5910-43d4-9f38-29288841b419', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:10:35 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-fe711057-65c7-47b3-b8cb-c0b6dae33210 req-9cc7c32e-5dfb-4bae-b441-9ceafe42a61a tempest-TestServerVolumeAttachmentScenario-850909200 None] attachment_update completed successfully. Jun 23 14:10:35 devstack sudo[133864]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b" returned: 0 in 0.936s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf4fa19-9e8a-4782-b401-84ddd8ead979]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:36 devstack sudo[133906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:10:36 devstack sudo[133906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:36 devstack sudo[133883]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 2147483648" returned: 0 in 1.018s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:36 devstack sudo[133930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 Jun 23 14:10:36 devstack sudo[133930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:36 devstack sudo[133906]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.939s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:36 devstack sudo[133972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b Jun 23 14:10:36 devstack sudo[133972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:37 devstack sudo[133930]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74" returned: 0 in 0.757s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.721s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-quobyte-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67-2d2a420d-6dff-4641-8529-113d56627cf6" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0730dbc7-bfcd-4ec8-82de-8a83c984ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c2a087-869b-4419-acbc-d62430502a74', 'volume_size': 2}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe32ce35-252b-45ae-8096-8142bf5010b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67-2d2a420d-6dff-4641-8529-113d56627cf6" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Creating volume 2d2a420d-6dff-4641-8529-113d56627cf6 from snapshot 5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-quobyte-2d2a420d-6dff-4641-8529-113d56627cf6" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:37 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Volume volume-47c2a087-869b-4419-acbc-d62430502a74 (47c2a087-869b-4419-acbc-d62430502a74): created successfully Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe32ce35-252b-45ae-8096-8142bf5010b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Flow 'volume_create_manager' (fed0b89b-7ec2-4328-95f0-8c609ccbfbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-2d2a420d-6dff-4641-8529-113d56627cf6" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] snapshot: 5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67, volume: 2d2a420d-6dff-4641-8529-113d56627cf6, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:10:37 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c9da2c9f-634d-479f-abd4-526aa2b98cd2 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Created volume successfully. Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a3531-edd3-4046-9420-c312ba4227c1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:37 devstack sudo[133990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 Jun 23 14:10:37 devstack sudo[133990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:37 devstack sudo[133972]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b" returned: 0 in 1.039s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:38 devstack sudo[134011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b Jun 23 14:10:38 devstack sudo[134011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:38 devstack sudo[133990]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" returned: 0 in 0.948s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-319ed14c-5e0c-405a-ac28-60e50ea87a01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9452bcd-5cd7-4973-941e-867fbe02c95f]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:38 devstack sudo[134029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:38 devstack sudo[134029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:38 devstack sudo[134011]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.2d646542-4fff-4b7c-8cf4-a08be4232d1b" returned: 0 in 0.764s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-2d646542-4fff-4b7c-8cf4-a08be4232d1b" released by "_delete_snapshot" :: held 3.822s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" released by "delete_snapshot" :: held 3.850s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Created reservations ['f0468afd-fe4c-4115-b08d-f6b9b347eebd', 'e22d6a81-c854-494a-ab8e-944a4f291ffe', 'b8d81463-a5aa-44e6-b77d-7bbe3e3c9e8e', 'c9ad9582-f2e9-4f0e-80ac-564d319e7701'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Delete snapshot completed successfully. Jun 23 14:10:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b5823cb7-4539-405e-a898-d81b6552bda6 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-2d646542-4fff-4b7c-8cf4-a08be4232d1b-delete_snapshot" released by "delete_snapshot" :: held 4.066s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:39 devstack sudo[134029]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 0.875s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:39 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:10:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:39 devstack sudo[134061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 Jun 23 14:10:39 devstack sudo[134061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-d148d510-d2d3-4dbc-a223-fe3c0895f117 req-a5690498-3c63-4c64-80a6-7bcfe9d6ad5e tempest-TestServerVolumeAttachmentScenario-850909200 None] Terminate volume connection completed successfully. Jun 23 14:10:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-d148d510-d2d3-4dbc-a223-fe3c0895f117 req-a5690498-3c63-4c64-80a6-7bcfe9d6ad5e tempest-TestServerVolumeAttachmentScenario-850909200 None] Deleting attachment a13ccf24-5910-43d4-9f38-29288841b419. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:10:44 devstack sudo[134061]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6" returned: 0 in 5.610s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:44 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cd0bf3-5c70-4261-8162-f814b9cd2e63]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:45 devstack sudo[134294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:45 devstack sudo[134294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:45 devstack sudo[134294]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 0.984s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:45 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:10:45 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Converted 1024.00 MB image at 182.49 MB/s Jun 23 14:10:45 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 is being set with open permissions: ugo+rw Jun 23 14:10:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:45 devstack sudo[134329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 Jun 23 14:10:45 devstack sudo[134329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:46 devstack sudo[134329]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6" returned: 0 in 0.713s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-2d2a420d-6dff-4641-8529-113d56627cf6" released by "_copy_volume_from_snapshot" :: held 9.251s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67-2d2a420d-6dff-4641-8529-113d56627cf6" released by "_create_volume_from_snapshot" :: held 9.306s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.348s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.575s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Creating offline snapshot faa849e0-b263-47c5-b906-92e320cb5bac of volume 47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d526df-4d40-4907-9ad3-8c34dec24366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2a420d-6dff-4641-8529-113d56627cf6', 'volume_size': 1, 'snapshot_id': '5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e444cdba-ecf0-4b4d-9333-9334381c927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0a1769-eacd-4a72-b418-28036fee2bf7]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Volume volume-2d2a420d-6dff-4641-8529-113d56627cf6 (2d2a420d-6dff-4641-8529-113d56627cf6): created successfully Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e444cdba-ecf0-4b4d-9333-9334381c927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Flow 'volume_create_manager' (ff14015c-d3fd-4006-8986-e0982cde0fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-423f7b27-9365-4502-a856-f534acec9cb6 tempest-SnapshotDependencyTests-1755068704 None] Created volume successfully. Jun 23 14:10:46 devstack sudo[134355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 Jun 23 14:10:46 devstack sudo[134355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-quobyte-319ed14c-5e0c-405a-ac28-60e50ea87a01" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-319ed14c-5e0c-405a-ac28-60e50ea87a01" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-quobyte-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Deleting offline snapshot 5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 of volume 319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] snapshot_file for this snap is: volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05b2f9-9e1e-4640-ba40-2dc4645d1f4d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-ca899611-7742-4d9d-ad0a-2aee69eb528c req-5ff441b8-09ab-46e8-9cb7-5d5b28b077ec tempest-TestServerVolumeAttachmentScenario-850909200 None] Terminate volume connection completed successfully. Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-ca899611-7742-4d9d-ad0a-2aee69eb528c req-5ff441b8-09ab-46e8-9cb7-5d5b28b077ec tempest-TestServerVolumeAttachmentScenario-850909200 None] Deleting attachment 791cbd75-98a4-4484-8ecc-a9cbf65a365b. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:10:47 devstack sudo[134376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 Jun 23 14:10:47 devstack sudo[134376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:47 devstack sudo[134355]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74" returned: 0 in 0.888s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac 2G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:47 devstack sudo[134395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac 2G Jun 23 14:10:47 devstack sudo[134395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:47 devstack sudo[134376]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" returned: 0 in 0.886s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-319ed14c-5e0c-405a-ac28-60e50ea87a01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[200aa3d1-d384-46b5-84c9-f5a8aff62a5c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:48 devstack sudo[134415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:48 devstack sudo[134415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:48 devstack sudo[134395]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac 2G" returned: 0 in 0.891s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c2a087-869b-4419-acbc-d62430502a74 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:48 devstack sudo[134432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c2a087-869b-4419-acbc-d62430502a74 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac Jun 23 14:10:48 devstack sudo[134432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:48 devstack sudo[134415]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 0.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:48 devstack sudo[134451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 Jun 23 14:10:48 devstack sudo[134451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:49 devstack sudo[134432]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c2a087-869b-4419-acbc-d62430502a74 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac" returned: 0 in 0.804s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:49 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac is being set with open permissions: ugo+rw Jun 23 14:10:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:49 devstack sudo[134467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac Jun 23 14:10:49 devstack sudo[134467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:49 devstack sudo[134451]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" returned: 0 in 0.913s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:49 devstack sudo[134489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67 Jun 23 14:10:49 devstack sudo[134489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:49 devstack sudo[134467]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac" returned: 0 in 0.705s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:50 devstack sudo[134499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info Jun 23 14:10:50 devstack sudo[134499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:50 devstack sudo[134489]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01.5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" returned: 0 in 0.902s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67" released by "_delete_snapshot" :: held 3.708s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-319ed14c-5e0c-405a-ac28-60e50ea87a01" released by "delete_snapshot" :: held 3.739s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Created reservations ['8042d7cd-7504-4194-a628-1c2a95549f9a', '5185fe9a-c09a-424d-984e-33469954b67b', 'b7b60f0d-1b1f-4b74-911a-8838930a2eb8', 'cdfd4603-6952-48dc-a43f-fad63966402c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Delete snapshot completed successfully. Jun 23 14:10:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c5094d6e-c619-4f81-bf3a-1d691ea4f073 tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-5f1a89c8-aac1-44fa-b63d-eb2e8aef2b67-delete_snapshot" released by "delete_snapshot" :: held 3.976s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:51 devstack sudo[134499]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info" returned: 0 in 1.001s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:51 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info is being set with open permissions: ugo+rw Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:51 devstack sudo[134569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info Jun 23 14:10:51 devstack sudo[134569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-319ed14c-5e0c-405a-ac28-60e50ea87a01-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-319ed14c-5e0c-405a-ac28-60e50ea87a01-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-quobyte-319ed14c-5e0c-405a-ac28-60e50ea87a01" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-319ed14c-5e0c-405a-ac28-60e50ea87a01" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdcacd9-5bf2-49a5-99f0-a6b9c6a0543b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:51 devstack sudo[134585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:51 devstack sudo[134585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:51 devstack sudo[134569]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.info" returned: 0 in 0.823s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.258s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.348s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Creating offline snapshot 9316ba50-4d68-442c-bf94-ad14b03641f2 of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3bf2bbbb-755d-4465-adfd-69a8814d96a5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Create snapshot completed successfully Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[702976dc-d8c7-4a2f-ae06-a1c0dbcf7c7a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:52 devstack sudo[134604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:10:52 devstack sudo[134604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:52 devstack sudo[134585]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 0.934s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:52 devstack sudo[134621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01 Jun 23 14:10:52 devstack sudo[134621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:52 devstack sudo[134604]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.933s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:52 devstack sudo[134643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 1G Jun 23 14:10:52 devstack sudo[134643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "cinder-faa849e0-b263-47c5-b906-92e320cb5bac-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-faa849e0-b263-47c5-b906-92e320cb5bac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "cinder-quobyte-47c2a087-869b-4419-acbc-d62430502a74" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-quobyte-47c2a087-869b-4419-acbc-d62430502a74" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "cinder-quobyte-faa849e0-b263-47c5-b906-92e320cb5bac" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-quobyte-faa849e0-b263-47c5-b906-92e320cb5bac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Deleting offline snapshot faa849e0-b263-47c5-b906-92e320cb5bac of volume 47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] snapshot_file for this snap is: volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4622fa3e-44eb-438d-9034-9ff01d30e513]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:53 devstack sudo[134621]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-319ed14c-5e0c-405a-ac28-60e50ea87a01" returned: 0 in 0.917s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-319ed14c-5e0c-405a-ac28-60e50ea87a01" released by "delete_volume" :: held 1.924s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:53 devstack sudo[134659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac Jun 23 14:10:53 devstack sudo[134659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Created reservations ['50f11c9e-08b9-4623-b48f-cdaf7d0a3b4b', '8c59c33b-d9a3-4827-a51f-ce8e9592b40b', '79d8e025-ec5b-405a-a185-7e84a22422ba', '94f6422e-5648-4f4a-9b38-45da52f48f7e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:53 devstack sudo[134669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:53 devstack sudo[134669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-2d2a420d-6dff-4641-8529-113d56627cf6-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-2d2a420d-6dff-4641-8529-113d56627cf6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "cinder-quobyte-2d2a420d-6dff-4641-8529-113d56627cf6" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-2d2a420d-6dff-4641-8529-113d56627cf6" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784359f-407d-40e9-b909-3e84a3a1937b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:53 devstack sudo[134682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 Jun 23 14:10:53 devstack sudo[134682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:54 devstack sudo[134643]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 1G" returned: 0 in 1.194s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:54 devstack sudo[134695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 Jun 23 14:10:54 devstack sudo[134695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:54 devstack sudo[134659]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac" returned: 0 in 1.036s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47c2a087-869b-4419-acbc-d62430502a74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedda520-b910-40c9-a73e-7c37bf217e0b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:54 devstack sudo[134708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 Jun 23 14:10:54 devstack sudo[134708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:54 devstack sudo[134669]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.966s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Deleted volume successfully. Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-369b09fc-0709-4c31-a6f8-28a484aad36b tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-319ed14c-5e0c-405a-ac28-60e50ea87a01-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:54 devstack sudo[134682]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6" returned: 0 in 1.055s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:54 devstack sudo[134727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6 Jun 23 14:10:54 devstack sudo[134727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:55 devstack sudo[134695]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2" returned: 0 in 0.930s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:55 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 is being set with open permissions: ugo+rw Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:55 devstack sudo[134737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 Jun 23 14:10:55 devstack sudo[134737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:55 devstack sudo[134708]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74" returned: 0 in 0.970s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:55 devstack sudo[134751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac Jun 23 14:10:55 devstack sudo[134751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:55 devstack sudo[134727]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2d2a420d-6dff-4641-8529-113d56627cf6" returned: 0 in 0.807s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-quobyte-2d2a420d-6dff-4641-8529-113d56627cf6" released by "delete_volume" :: held 1.914s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Created reservations ['fe082771-d043-4979-a9de-f95dee697bbd', '3ec0655d-c63a-4d09-b089-17ee21919458', '29a18cdc-f7d4-4723-8291-5cdce334ca32', 'f1781da2-3223-4f2f-bc95-6a90e4b96869'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:55 devstack sudo[134737]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2" returned: 0 in 0.788s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.026s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e72e51d1-7774-4135-ad6f-6ea855ed8565 tempest-SnapshotsActionsTest-1611807228 None] Create snapshot completed successfully Jun 23 14:10:55 devstack sudo[134773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:10:55 devstack sudo[134773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:56 devstack sudo[134751]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac" returned: 0 in 0.903s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:56 devstack sudo[134787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac Jun 23 14:10:56 devstack sudo[134787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-9316ba50-4d68-442c-bf94-ad14b03641f2-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-9316ba50-4d68-442c-bf94-ad14b03641f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-9316ba50-4d68-442c-bf94-ad14b03641f2" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-9316ba50-4d68-442c-bf94-ad14b03641f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Deleting offline snapshot 9316ba50-4d68-442c-bf94-ad14b03641f2 of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] snapshot_file for this snap is: volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4002534a-357d-437b-8462-53d46e66da28]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:56 devstack sudo[134773]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.887s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Deleted volume successfully. Jun 23 14:10:56 devstack sudo[134805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 Jun 23 14:10:56 devstack sudo[134805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-c0106cd8-d99c-451b-addc-20fb867e5f7c tempest-SnapshotDependencyTests-1755068704 None] Lock "cinder-2d2a420d-6dff-4641-8529-113d56627cf6-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:57 devstack sudo[134787]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74.faa849e0-b263-47c5-b906-92e320cb5bac" returned: 0 in 0.873s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-quobyte-faa849e0-b263-47c5-b906-92e320cb5bac" released by "_delete_snapshot" :: held 3.971s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-quobyte-47c2a087-869b-4419-acbc-d62430502a74" released by "delete_snapshot" :: held 4.007s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Created reservations ['b3378351-f7ac-4330-9365-8a698f6948b6', '966d7ad4-bf68-49e1-badc-7e1a7a97854a', '378f6c79-10ce-48b8-a505-c6e76e5b517e', 'd1a0ed5c-1199-4b6a-b115-607a0ac72fae'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Delete snapshot completed successfully. Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-263b5390-83d8-4f11-a87b-71c43503e6b5 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-faa849e0-b263-47c5-b906-92e320cb5bac-delete_snapshot" released by "delete_snapshot" :: held 4.276s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "cinder-47c2a087-869b-4419-acbc-d62430502a74-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-47c2a087-869b-4419-acbc-d62430502a74-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "cinder-quobyte-47c2a087-869b-4419-acbc-d62430502a74" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-quobyte-47c2a087-869b-4419-acbc-d62430502a74" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5908109-e983-4cd4-b0a1-005660e5ded0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:57 devstack sudo[134805]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2" returned: 0 in 1.117s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62747bd-a908-4960-98fd-537fef5c2dd6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:57 devstack sudo[134844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 Jun 23 14:10:57 devstack sudo[134844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:58 devstack sudo[134848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:10:58 devstack sudo[134848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "cinder-6d9cc84f-d9a1-4743-81c4-66e529afba73-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-6d9cc84f-d9a1-4743-81c4-66e529afba73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "cinder-quobyte-6d9cc84f-d9a1-4743-81c4-66e529afba73" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-quobyte-6d9cc84f-d9a1-4743-81c4-66e529afba73" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17bfce-41fc-47df-a757-aee23917e5e0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:58 devstack sudo[134874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 Jun 23 14:10:58 devstack sudo[134874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:58 devstack sudo[134848]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 1.072s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:59 devstack sudo[134844]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74" returned: 0 in 1.185s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:59 devstack sudo[134893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 Jun 23 14:10:59 devstack sudo[134893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:59 devstack sudo[134894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74 Jun 23 14:10:59 devstack sudo[134894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:59 devstack sudo[134874]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73" returned: 0 in 1.001s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:59 devstack sudo[134920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73 Jun 23 14:10:59 devstack sudo[134920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:00 devstack sudo[134894]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-47c2a087-869b-4419-acbc-d62430502a74" returned: 0 in 0.977s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-quobyte-47c2a087-869b-4419-acbc-d62430502a74" released by "delete_volume" :: held 2.254s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Created reservations ['55f67b34-e19e-4139-af63-edd113b6abe2', '5d7e1e6f-f1c1-4a7f-9563-96432a9a58c1', 'c232c08e-2dc8-43f8-b1c1-aca635cf34b9', '12f8118c-d06d-4039-a435-d6472f358e54'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:00 devstack sudo[134893]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2" returned: 0 in 1.298s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:00 devstack sudo[134946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2 Jun 23 14:11:00 devstack sudo[134946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:00 devstack sudo[134949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:00 devstack sudo[134949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:00 devstack sudo[134920]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-6d9cc84f-d9a1-4743-81c4-66e529afba73" returned: 0 in 0.920s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-quobyte-6d9cc84f-d9a1-4743-81c4-66e529afba73" released by "delete_volume" :: held 1.979s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Created reservations ['ea3e4c4c-237c-47b9-95c2-494bb7d8183d', '49b9deae-b596-459c-93a4-64fc9d8782e8', '3d353384-5e20-48d3-a93d-ede866261828', 'dfff98ba-9c98-41ee-b9c7-84c67c880755'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:00 devstack sudo[134967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:00 devstack sudo[134967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "cinder-c5055f01-88bf-47c1-8612-4c8b7389ce86-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-c5055f01-88bf-47c1-8612-4c8b7389ce86-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "cinder-quobyte-c5055f01-88bf-47c1-8612-4c8b7389ce86" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-quobyte-c5055f01-88bf-47c1-8612-4c8b7389ce86" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[74106d77-715a-4cdb-9999-e2c4d87e1650]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:01 devstack sudo[134949]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.926s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:01 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Deleted volume successfully. Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ea8162e3-3b2f-426b-8104-662002011e17 tempest-VolumesSnapshotNegativeTestJSON-132268124 None] Lock "cinder-47c2a087-869b-4419-acbc-d62430502a74-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:01 devstack sudo[134979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 Jun 23 14:11:01 devstack sudo[134979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:01 devstack sudo[134946]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.9316ba50-4d68-442c-bf94-ad14b03641f2" returned: 0 in 1.193s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-9316ba50-4d68-442c-bf94-ad14b03641f2" released by "_delete_snapshot" :: held 4.852s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" released by "delete_snapshot" :: held 4.894s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Created reservations ['16d586d7-6dfd-4d28-ab71-3e4571544823', '1da648ca-9740-4151-af31-0b895cd7b746', '4c2aca45-1e39-4d49-a14f-f4a488effc0f', '71676e3f-2023-479d-9508-2a2667747e89'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:01 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Delete snapshot completed successfully. Jun 23 14:11:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-232d3bba-b35d-4e59-be8c-d743046736a4 tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-9316ba50-4d68-442c-bf94-ad14b03641f2-delete_snapshot" released by "delete_snapshot" :: held 5.153s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:02 devstack sudo[134967]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.159s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Deleted volume successfully. Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-09811f90-8e1f-4277-a5ec-8a3c06315e11 tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-6d9cc84f-d9a1-4743-81c4-66e529afba73-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:02 devstack sudo[134979]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86" returned: 0 in 1.260s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:02 devstack sudo[135023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86 Jun 23 14:11:02 devstack sudo[135023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=104,cinder:UPDATE=107,cinder:DELETE=9,cinder:INSERT=29 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Creating offline snapshot 0aa9d227-2c15-4275-b687-4b833ab5927a of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5861e34-acbc-4f06-80fa-a2fd36f64444]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:02 devstack sudo[135034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:02 devstack sudo[135034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:03 devstack sudo[135023]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c5055f01-88bf-47c1-8612-4c8b7389ce86" returned: 0 in 1.003s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-quobyte-c5055f01-88bf-47c1-8612-4c8b7389ce86" released by "delete_volume" :: held 2.364s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=111,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=8 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Created reservations ['713adfdf-ec82-4702-b8ab-c08d37f2746b', '05a07dce-67a1-444c-ae8f-3cf92032a860', '981e85b2-ccdd-466b-b15f-55cc98236953', 'a992fc52-cac9-4f06-8f18-7c346c4cf7dd'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:03 devstack sudo[135070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:03 devstack sudo[135070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:03 devstack sudo[135034]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 1.086s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:03 devstack sudo[135075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a 1G Jun 23 14:11:03 devstack sudo[135075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:04 devstack sudo[135070]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.010s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:04 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:04 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Deleted volume successfully. Jun 23 14:11:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-93863af9-40cc-4907-8edb-07e3df89a5fd tempest-TestServerVolumeAttachmentScenario-850909200 None] Lock "cinder-c5055f01-88bf-47c1-8612-4c8b7389ce86-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:05 devstack sudo[135075]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a 1G" returned: 0 in 1.310s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:05 devstack sudo[135124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a Jun 23 14:11:05 devstack sudo[135124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (b2a0edb1-2b2c-45bc-b8d4-caccd1bbda84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284d1df0-96e2-43c5-827c-12f9c3eb7c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack sudo[135124]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284d1df0-96e2-43c5-827c-12f9c3eb7c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969288665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943d85d9-4e76-4953-bfb7-8d89cf7b17cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:06Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e59ac2d-51fb-4f43-85ce-78843413457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e59ac2d-51fb-4f43-85ce-78843413457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49197c6c-a8f6-4caa-83a6-7b44f110ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49197c6c-a8f6-4caa-83a6-7b44f110ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943d85d9-4e76-4953-bfb7-8d89cf7b17cf', 'volume_name': 'volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ed83b2-5c06-4a04-9aa7-d3a067d660d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ed83b2-5c06-4a04-9aa7-d3a067d660d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aabf95-6f1d-479d-9788-f2922c51b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Volume 943d85d9-4e76-4953-bfb7-8d89cf7b17cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf', 'volume_size': 1} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a" returned: 0 in 1.267s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:06 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a is being set with open permissions: ugo+rw Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:06 devstack sudo[135174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a Jun 23 14:11:06 devstack sudo[135174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (6b63c53d-060f-46bc-83ba-d3de5220a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6493b2bc-7e66-455d-961f-656724b52bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6493b2bc-7e66-455d-961f-656724b52bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399138853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:07Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76e9a3c-074b-4aea-ba8f-79a454306954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76e9a3c-074b-4aea-ba8f-79a454306954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c718ec9-00a5-4af5-a106-7c24b16e4020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c718ec9-00a5-4af5-a106-7c24b16e4020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3', 'volume_name': 'volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35165faf-6b90-4d76-9da3-d4c373269284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35165faf-6b90-4d76-9da3-d4c373269284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6400ac-8457-4a32-917c-f27ec75252d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Volume c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3', 'volume_size': 1} Jun 23 14:11:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (1b206666-ca17-40d3-b1d6-a2b4b3ed9f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ebe8d4-b088-4e1f-bc1a-76540b32f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ebe8d4-b088-4e1f-bc1a-76540b32f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399011671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a7c091-314d-41db-976e-4880a1a13656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:07Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022b9f9e-9d5a-485d-b4e7-2296825a3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022b9f9e-9d5a-485d-b4e7-2296825a3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3220dc-faae-4afc-b7a6-3d11fd95ba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3220dc-faae-4afc-b7a6-3d11fd95ba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a7c091-314d-41db-976e-4880a1a13656', 'volume_name': 'volume-00a7c091-314d-41db-976e-4880a1a13656', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b30ad4f-132a-4a66-b70d-d5c8d2add0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b30ad4f-132a-4a66-b70d-d5c8d2add0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07665c1c-f7d1-434e-96c8-e464c954928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:07 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Volume 00a7c091-314d-41db-976e-4880a1a13656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a7c091-314d-41db-976e-4880a1a13656', 'volume_size': 1} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:07 devstack sudo[135174]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a" returned: 0 in 1.234s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.089s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969288665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943d85d9-4e76-4953-bfb7-8d89cf7b17cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:06Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Creating volume 943d85d9-4e76-4953-bfb7-8d89cf7b17cf {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:07 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:07 devstack sudo[135217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf 1073741824 Jun 23 14:11:07 devstack sudo[135217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:07 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-69d24255-cc94-45be-86a0-fb8e49944afd tempest-SnapshotsActionsTest-1611807228 None] Create snapshot completed successfully Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (f85b2045-55ac-46b3-abc6-0027b93f00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85671c9-944b-4443-a088-2b8438048736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85671c9-944b-4443-a088-2b8438048736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349059295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1644f51d-8497-40c6-958d-f354f94b812f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:08Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20164d6-71f6-4fa7-a350-0d8730b9c102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20164d6-71f6-4fa7-a350-0d8730b9c102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3ace83-2a29-4786-a1f1-b7d536d81617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3ace83-2a29-4786-a1f1-b7d536d81617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1644f51d-8497-40c6-958d-f354f94b812f', 'volume_name': 'volume-1644f51d-8497-40c6-958d-f354f94b812f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcbc7aa-9e1b-4105-98e0-d7b41c3517fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcbc7aa-9e1b-4105-98e0-d7b41c3517fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761e39a7-6f44-469d-ae99-6784e92a5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Volume 1644f51d-8497-40c6-958d-f354f94b812f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1644f51d-8497-40c6-958d-f354f94b812f', 'volume_size': 1} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (b5cd0823-6b81-4a0f-9b05-0286e0ee7fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66a9df5-d922-43af-92bc-e39193c3f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66a9df5-d922-43af-92bc-e39193c3f388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394197759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edae688c-dc5c-4800-9fd0-91ab6bc43766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:09Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f6aea4-fc8a-44a0-b04a-8bdd66ed2d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f6aea4-fc8a-44a0-b04a-8bdd66ed2d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9d7b0d-6643-4124-8fb8-06380c87f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9d7b0d-6643-4124-8fb8-06380c87f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edae688c-dc5c-4800-9fd0-91ab6bc43766', 'volume_name': 'volume-edae688c-dc5c-4800-9fd0-91ab6bc43766', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c53dec-f30e-41c3-b7a6-eb6b3f367f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c53dec-f30e-41c3-b7a6-eb6b3f367f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842a3a07-1e19-4e04-bbf6-166742ecdc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Volume edae688c-dc5c-4800-9fd0-91ab6bc43766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edae688c-dc5c-4800-9fd0-91ab6bc43766', 'volume_size': 1} Jun 23 14:11:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:09 devstack sudo[135217]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf 1073741824" returned: 0 in 1.534s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-0aa9d227-2c15-4275-b687-4b833ab5927a-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:09 devstack sudo[135271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf Jun 23 14:11:09 devstack sudo[135271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-0aa9d227-2c15-4275-b687-4b833ab5927a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-0aa9d227-2c15-4275-b687-4b833ab5927a" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-0aa9d227-2c15-4275-b687-4b833ab5927a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Deleting offline snapshot 0aa9d227-2c15-4275-b687-4b833ab5927a of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] snapshot_file for this snap is: volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24c43e-ba02-46ef-aacd-c1ed11ac4b98]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:09 devstack sudo[135280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a Jun 23 14:11:09 devstack sudo[135280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:10 devstack sudo[135271]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf" returned: 0 in 1.001s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] <== create_volume: return (2630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.423s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399138853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:07Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Creating volume c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:10 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aabf95-6f1d-479d-9788-f2922c51b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca39ef0-4648-4c74-842b-b73d7cd377d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:10 devstack sudo[135307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 1073741824 Jun 23 14:11:10 devstack sudo[135307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:10 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Volume volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf (943d85d9-4e76-4953-bfb7-8d89cf7b17cf): created successfully Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca39ef0-4648-4c74-842b-b73d7cd377d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (b2a0edb1-2b2c-45bc-b8d4-caccd1bbda84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:10 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-baad4106-9332-4c59-a8ed-42eb511c2495 tempest-CreateVolumesFromImageTest-1031895380 None] Created volume successfully. Jun 23 14:11:10 devstack sudo[135280]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a" returned: 0 in 1.321s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b471ea60-8b86-4112-a608-934e0767f830]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:11 devstack sudo[135332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:11 devstack sudo[135332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:11 devstack sudo[135307]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 1073741824" returned: 0 in 1.172s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:11 devstack sudo[135356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 Jun 23 14:11:11 devstack sudo[135356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:12 devstack sudo[135332]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 1.164s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:12 devstack sudo[135377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a Jun 23 14:11:12 devstack sudo[135377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:12 devstack sudo[135356]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3" returned: 0 in 0.973s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.087s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399011671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a7c091-314d-41db-976e-4880a1a13656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:07Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Creating volume 00a7c091-314d-41db-976e-4880a1a13656 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:12 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6400ac-8457-4a32-917c-f27ec75252d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:12 devstack sudo[135395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 1073741824 Jun 23 14:11:12 devstack sudo[135395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5284571-f36a-4c2a-9970-ab893d3fb023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:12 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Volume volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 (c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3): created successfully Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5284571-f36a-4c2a-9970-ab893d3fb023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:12 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (6b63c53d-060f-46bc-83ba-d3de5220a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:12 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-12634371-18fd-491f-93a3-b945c2c41ab8 tempest-CreateVolumesFromImageTest-1031895380 None] Created volume successfully. Jun 23 14:11:13 devstack sudo[135377]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a" returned: 0 in 1.118s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:13 devstack sudo[135421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a Jun 23 14:11:13 devstack sudo[135421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:13 devstack sudo[135395]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 1073741824" returned: 0 in 1.066s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:13 devstack sudo[135439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 Jun 23 14:11:13 devstack sudo[135439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:14 devstack sudo[135421]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.0aa9d227-2c15-4275-b687-4b833ab5927a" returned: 0 in 0.756s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-0aa9d227-2c15-4275-b687-4b833ab5927a" released by "_delete_snapshot" :: held 4.549s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" released by "delete_snapshot" :: held 4.611s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Created reservations ['e2a59e2b-d623-4a1a-b915-44faac9d4796', '0245e2f3-e21c-4892-9698-d71a1e684f5d', '3a690850-811d-4f8f-9c73-f75c2946f05e', '7021a938-da2b-4a35-9016-6bcc24cd00c1'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:14 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Delete snapshot completed successfully. Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bc6a95ea-b338-494b-8bea-3d86298e333a tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-0aa9d227-2c15-4275-b687-4b833ab5927a-delete_snapshot" released by "delete_snapshot" :: held 4.862s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:14 devstack sudo[135439]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656" returned: 0 in 0.782s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.344s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349059295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1644f51d-8497-40c6-958d-f354f94b812f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:08Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Creating volume 1644f51d-8497-40c6-958d-f354f94b812f {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:14 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:14 devstack sudo[135467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f 1073741824 Jun 23 14:11:14 devstack sudo[135467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07665c1c-f7d1-434e-96c8-e464c954928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a7c091-314d-41db-976e-4880a1a13656', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4815ea0-f296-4459-9a9d-05f57bf273da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:14 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Volume volume-00a7c091-314d-41db-976e-4880a1a13656 (00a7c091-314d-41db-976e-4880a1a13656): created successfully Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4815ea0-f296-4459-9a9d-05f57bf273da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (1b206666-ca17-40d3-b1d6-a2b4b3ed9f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:14 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-89107c82-9780-4645-8300-ab0a529efb57 tempest-CreateVolumesFromImageTest-1031895380 None] Created volume successfully. Jun 23 14:11:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:15 devstack sudo[135467]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f 1073741824" returned: 0 in 1.268s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:15 devstack sudo[135514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f Jun 23 14:11:15 devstack sudo[135514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:16 devstack sudo[135514]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f" returned: 0 in 0.769s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.690s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394197759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edae688c-dc5c-4800-9fd0-91ab6bc43766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffddb5b27f9441b5a9c912e15cf79b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:09Z,use_quota=True,user_id='df257a9a3e7b47f59910d33952a6c301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Creating volume edae688c-dc5c-4800-9fd0-91ab6bc43766 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:16 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:16 devstack sudo[135541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 1073741824 Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761e39a7-6f44-469d-ae99-6784e92a5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1644f51d-8497-40c6-958d-f354f94b812f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:16 devstack sudo[135541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e898d1-4e44-4fd3-99d5-d72ad56ede18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:16 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Volume volume-1644f51d-8497-40c6-958d-f354f94b812f (1644f51d-8497-40c6-958d-f354f94b812f): created successfully Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e898d1-4e44-4fd3-99d5-d72ad56ede18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (f85b2045-55ac-46b3-abc6-0027b93f00e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3e5811a6-f25f-43c3-a3f9-fa14e289d52d tempest-CreateVolumesFromImageTest-1031895380 None] Created volume successfully. Jun 23 14:11:17 devstack sudo[135541]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 1073741824" returned: 0 in 1.015s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:17 devstack sudo[135577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 Jun 23 14:11:17 devstack sudo[135577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:18 devstack sudo[135577]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766" returned: 0 in 0.683s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.195s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842a3a07-1e19-4e04-bbf6-166742ecdc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edae688c-dc5c-4800-9fd0-91ab6bc43766', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba64f6b-2105-474a-86c8-478419fcee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Creating offline snapshot 60a7cac1-ac32-4a2d-a764-db0b61ff453a of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:11:18 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Volume volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 (edae688c-dc5c-4800-9fd0-91ab6bc43766): created successfully Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba64f6b-2105-474a-86c8-478419fcee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Flow 'volume_create_manager' (b5cd0823-6b81-4a0f-9b05-0286e0ee7fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e7bea7-a897-4d68-b6a6-7f0d82f0b30b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:18 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ea068328-0b69-4ced-bc29-3a6fd7b3faea tempest-CreateVolumesFromImageTest-1031895380 None] Created volume successfully. Jun 23 14:11:18 devstack sudo[135604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:18 devstack sudo[135604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-edae688c-dc5c-4800-9fd0-91ab6bc43766-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-edae688c-dc5c-4800-9fd0-91ab6bc43766-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-quobyte-edae688c-dc5c-4800-9fd0-91ab6bc43766" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-edae688c-dc5c-4800-9fd0-91ab6bc43766" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f3dfb-8e7a-4c19-a654-18209daa7806]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:19 devstack sudo[135624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 Jun 23 14:11:19 devstack sudo[135624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:19 devstack sudo[135604]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.978s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:19 devstack sudo[135642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a 1G Jun 23 14:11:19 devstack sudo[135642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:20 devstack sudo[135624]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766" returned: 0 in 0.935s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:20 devstack sudo[135665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766 Jun 23 14:11:20 devstack sudo[135665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:20 devstack sudo[135642]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a 1G" returned: 0 in 1.107s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:20 devstack sudo[135686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a Jun 23 14:11:20 devstack sudo[135686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:20 devstack sudo[135665]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-edae688c-dc5c-4800-9fd0-91ab6bc43766" returned: 0 in 0.821s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-edae688c-dc5c-4800-9fd0-91ab6bc43766" released by "delete_volume" :: held 1.827s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:20 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Created reservations ['aa5020d8-71be-473f-9b28-a83191279050', 'ab4bce34-35ba-42c1-844e-ac5856fd93d0', 'b2db60eb-6cdb-4316-9f12-c6a541a82728', 'a11edc2f-d548-4da8-af3a-193c5a05c5c2'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:21 devstack sudo[135702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:21 devstack sudo[135702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-1644f51d-8497-40c6-958d-f354f94b812f-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-1644f51d-8497-40c6-958d-f354f94b812f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:21 devstack sudo[135686]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a" returned: 0 in 0.840s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:21 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a is being set with open permissions: ugo+rw Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:21 devstack sudo[135719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a Jun 23 14:11:21 devstack sudo[135719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-quobyte-1644f51d-8497-40c6-958d-f354f94b812f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-1644f51d-8497-40c6-958d-f354f94b812f" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c1459-c56a-4a19-9f2b-4de858f24dd1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:21 devstack sudo[135724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f Jun 23 14:11:21 devstack sudo[135724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:21 devstack sudo[135702]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.924s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Deleted volume successfully. Jun 23 14:11:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6b23dd40-9f6e-43a8-a84e-a575c8743e63 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-edae688c-dc5c-4800-9fd0-91ab6bc43766-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:22 devstack sudo[135719]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a" returned: 0 in 0.791s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.885s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-01163244-96d7-45b4-aeb5-5058214c24c2 tempest-SnapshotsActionsTest-1611807228 None] Create snapshot completed successfully Jun 23 14:11:22 devstack sudo[135724]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f" returned: 0 in 1.022s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:22 devstack sudo[135761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f Jun 23 14:11:22 devstack sudo[135761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-60a7cac1-ac32-4a2d-a764-db0b61ff453a-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-60a7cac1-ac32-4a2d-a764-db0b61ff453a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Acquiring lock "cinder-quobyte-60a7cac1-ac32-4a2d-a764-db0b61ff453a" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-60a7cac1-ac32-4a2d-a764-db0b61ff453a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Deleting offline snapshot 60a7cac1-ac32-4a2d-a764-db0b61ff453a of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] snapshot_file for this snap is: volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba2dfc5-de74-4bed-af60-21b1c42902eb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:22 devstack sudo[135772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a Jun 23 14:11:22 devstack sudo[135772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:23 devstack sudo[135761]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1644f51d-8497-40c6-958d-f354f94b812f" returned: 0 in 0.769s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-1644f51d-8497-40c6-958d-f354f94b812f" released by "delete_volume" :: held 1.844s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Created reservations ['90df6702-9540-46bf-9fc3-971c6ffaf89d', 'e3bab9a0-cbd7-4553-8ad6-1caeb3de07de', '9c31f0ab-fbe0-4c71-9e5f-c26f58c0b3cc', '635e21a9-1abc-434b-bfb9-4f8475bc74b1'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:23 devstack sudo[135795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:23 devstack sudo[135795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-00a7c091-314d-41db-976e-4880a1a13656-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-00a7c091-314d-41db-976e-4880a1a13656-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-quobyte-00a7c091-314d-41db-976e-4880a1a13656" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-00a7c091-314d-41db-976e-4880a1a13656" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff38ce3-6d52-4be5-a65f-5e6318ff7fa4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:23 devstack sudo[135772]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a" returned: 0 in 1.013s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9232b0-6aae-456b-ba4c-a2606f20205c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:23 devstack sudo[135807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 Jun 23 14:11:23 devstack sudo[135807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:23 devstack sudo[135811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:23 devstack sudo[135811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:24 devstack sudo[135795]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.935s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Deleted volume successfully. Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5dfc8022-925a-4232-823c-acbd9f13cde2 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-1644f51d-8497-40c6-958d-f354f94b812f-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:24 devstack sudo[135807]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656" returned: 0 in 1.105s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:24 devstack sudo[135851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656 Jun 23 14:11:24 devstack sudo[135851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:24 devstack sudo[135811]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 1.084s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:24 devstack sudo[135856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a Jun 23 14:11:24 devstack sudo[135856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:25 devstack sudo[135851]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-00a7c091-314d-41db-976e-4880a1a13656" returned: 0 in 0.856s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-00a7c091-314d-41db-976e-4880a1a13656" released by "delete_volume" :: held 2.028s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Created reservations ['22a001a4-0afe-4639-812e-d28ef9fd7ed2', '28dfedc2-6a68-47e9-a27a-85893db44625', '138265c8-8821-461b-8aa8-74fe5836d519', 'b94e4c90-5d18-4bb3-b0b0-855b1c1df932'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:25 devstack sudo[135894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:25 devstack sudo[135894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:25 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:25 devstack sudo[135856]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a" returned: 0 in 1.113s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-quobyte-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:26 devstack sudo[135899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3" acquired by "delete_volume" :: waited 0.065s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:26 devstack sudo[135899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a2803-ec1c-4b38-b0e1-f8f8369d0143]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:26 devstack sudo[135904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 Jun 23 14:11:26 devstack sudo[135904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:26 devstack sudo[135894]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Deleted volume successfully. Jun 23 14:11:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7322a0d4-27b3-47bd-bfab-f29c7c0c0d03 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-00a7c091-314d-41db-976e-4880a1a13656-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:27 devstack sudo[135899]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.60a7cac1-ac32-4a2d-a764-db0b61ff453a" returned: 0 in 1.213s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-60a7cac1-ac32-4a2d-a764-db0b61ff453a" released by "_delete_snapshot" :: held 4.578s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" released by "delete_snapshot" :: held 4.613s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:27 devstack sudo[135904]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3" returned: 0 in 1.220s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:27 devstack sudo[135948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3 Jun 23 14:11:27 devstack sudo[135948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Created reservations ['1676db8e-9012-4335-81f7-a40bc5f5c7e3', '0b43504f-d2a8-4577-a734-9742ff7c19cb', '2e5583fb-6d15-454d-8b9e-98b8b6497e94', 'cf5f0d26-164c-4fa9-afe6-27ca57d0442c'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Delete snapshot completed successfully. Jun 23 14:11:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2e7f8c5a-a5dc-4fd4-8b83-2bf51ef56e6c tempest-SnapshotsActionsTest-373486861 None] Lock "cinder-60a7cac1-ac32-4a2d-a764-db0b61ff453a-delete_snapshot" released by "delete_snapshot" :: held 4.822s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:28 devstack sudo[135948]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3" returned: 0 in 0.979s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3" released by "delete_volume" :: held 2.266s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Created reservations ['213b28ae-637f-406f-a04f-d92c3aedf697', 'befd1e4a-a199-4b20-b359-b6006dcaeb78', '33167ac7-f141-4e33-9f5f-371a4bd73bfc', 'c5ab8494-e0ef-44e9-b9c5-4dbbab571c7e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "cinder-ed00b28c-e0f0-4a31-807b-cc434da448ae-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:28 devstack sudo[135987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:28 devstack sudo[135987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-ed00b28c-e0f0-4a31-807b-cc434da448ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "cinder-quobyte-ed00b28c-e0f0-4a31-807b-cc434da448ae" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-quobyte-ed00b28c-e0f0-4a31-807b-cc434da448ae" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Deleting offline snapshot ed00b28c-e0f0-4a31-807b-cc434da448ae of volume 82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] snapshot_file for this snap is: volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[87552ba7-baf5-4e72-b0cf-4b818ba29514]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:28 devstack sudo[135995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:28 devstack sudo[135995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:29 devstack sudo[135987]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.832s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:29 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Deleted volume successfully. Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-882fd7e6-7a12-4152-b7ba-54606924c59a tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-c4a8da2c-800d-4926-9ef0-2a5fa3c2bda3-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-943d85d9-4e76-4953-bfb7-8d89cf7b17cf-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-943d85d9-4e76-4953-bfb7-8d89cf7b17cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "cinder-quobyte-943d85d9-4e76-4953-bfb7-8d89cf7b17cf" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-943d85d9-4e76-4953-bfb7-8d89cf7b17cf" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c899ab-e3d5-4793-8929-3c53b7f1d8c9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:29 devstack sudo[135995]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 1.121s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d240cb-7e13-4030-96e6-be8a20d88daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:11:29 devstack sudo[136028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf Jun 23 14:11:29 devstack sudo[136028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81129c2-69e1-4300-9fb2-8149a230a340]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:30 devstack sudo[136036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa Jun 23 14:11:30 devstack sudo[136036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:30 devstack sudo[136028]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf" returned: 0 in 1.149s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:30 devstack sudo[136072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf Jun 23 14:11:30 devstack sudo[136072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:30 devstack sudo[136036]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa" returned: 0 in 0.972s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:30 devstack sudo[136077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:30 devstack sudo[136077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:31 devstack sudo[136072]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-943d85d9-4e76-4953-bfb7-8d89cf7b17cf" returned: 0 in 0.865s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-quobyte-943d85d9-4e76-4953-bfb7-8d89cf7b17cf" released by "delete_volume" :: held 2.092s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Created reservations ['26172584-0447-4c38-9662-8d7d05e34410', '3ebd2406-1fac-4a08-93e7-8f6bb87d2735', 'cd24de56-5fcc-4051-8802-b5c2b602689e', '849f727c-aa65-4372-991f-1691d8857b88'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:31 devstack sudo[136077]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.964s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:31 devstack sudo[136114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae Jun 23 14:11:31 devstack sudo[136114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:31 devstack sudo[136116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:31 devstack sudo[136116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:32 devstack sudo[136133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:32 devstack sudo[136133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:32 devstack sudo[136116]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.880s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:32 devstack sudo[136114]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa.ed00b28c-e0f0-4a31-807b-cc434da448ae" returned: 0 in 0.938s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Deleted volume successfully. Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-quobyte-ed00b28c-e0f0-4a31-807b-cc434da448ae" released by "_delete_snapshot" :: held 4.199s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9d8632ff-6cf7-473e-8983-6d08034865c7 tempest-CreateVolumesFromImageTest-1031895380 None] Lock "cinder-943d85d9-4e76-4953-bfb7-8d89cf7b17cf-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" released by "delete_snapshot" :: held 4.237s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:32 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Created reservations ['609f73f2-094a-4ef4-a1b7-4db65e357c31', '53111418-a64c-4754-9349-15b1c361dd23', 'bb56f6e0-81f7-4986-a510-30798edf34ec', '1fc38e1f-a43e-4ddd-8bd6-22700ba664d6'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Delete snapshot completed successfully. Jun 23 14:11:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-149b11a4-a6b2-4ac8-ad9f-a50b212b185d tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-ed00b28c-e0f0-4a31-807b-cc434da448ae-delete_snapshot" released by "delete_snapshot" :: held 4.464s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:33 devstack sudo[136133]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.895s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:11:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:11:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:11:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "cinder-82d240cb-7e13-4030-96e6-be8a20d88daa-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-82d240cb-7e13-4030-96e6-be8a20d88daa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" acquired by "delete_volume" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:34 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c71db-1245-4adc-91fb-9ececf5ed31c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:34 devstack sudo[136193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa Jun 23 14:11:34 devstack sudo[136193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:35 devstack sudo[136193]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa" returned: 0 in 0.939s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:35 devstack sudo[136229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa Jun 23 14:11:35 devstack sudo[136229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:36 devstack sudo[136229]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-82d240cb-7e13-4030-96e6-be8a20d88daa" returned: 0 in 0.911s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-quobyte-82d240cb-7e13-4030-96e6-be8a20d88daa" released by "delete_volume" :: held 1.939s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Created reservations ['3f1c1d38-8a6a-4968-86c2-f26b22156839', 'ef53fb0f-b9cb-4b14-abcb-47eeff41edfc', 'e20950cc-bb43-4905-821e-400cac2f4b8a', 'f8aafdf5-69dc-4342-8c0e-39a461722206'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:36 devstack sudo[136267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:36 devstack sudo[136267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (e19865ba-c014-4d0c-a282-a8a4416e4877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7868f253-3e7d-4ed2-9e31-05ddc9d8a948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7868f253-3e7d-4ed2-9e31-05ddc9d8a948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490837071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccfb7f5-f1ba-40f1-9455-909645b10415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:37Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5768b808-7b22-48f0-b68e-180b23bb15d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5768b808-7b22-48f0-b68e-180b23bb15d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925c060f-5d9d-4f1a-965e-80ac1b8cf372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925c060f-5d9d-4f1a-965e-80ac1b8cf372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ccfb7f5-f1ba-40f1-9455-909645b10415', 'volume_name': 'volume-1ccfb7f5-f1ba-40f1-9455-909645b10415', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c682cc25-29dc-4189-b54c-49ad6ad1e277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c682cc25-29dc-4189-b54c-49ad6ad1e277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32a7f49-444d-46fe-ac15-0fec277791fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume 1ccfb7f5-f1ba-40f1-9455-909645b10415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ccfb7f5-f1ba-40f1-9455-909645b10415', 'volume_size': 1} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1490837071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccfb7f5-f1ba-40f1-9455-909645b10415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:37Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Creating volume 1ccfb7f5-f1ba-40f1-9455-909645b10415 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:36 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:36 devstack sudo[136284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 1073741824 Jun 23 14:11:36 devstack sudo[136284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:37 devstack sudo[136267]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.033s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:37 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:37 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Deleted volume successfully. Jun 23 14:11:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8103cc4e-2ec5-48ec-9c58-b33bf8f2efee tempest-SnapshotsActionsTest-1611807228 None] Lock "cinder-82d240cb-7e13-4030-96e6-be8a20d88daa-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:38 devstack sudo[136284]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 1073741824" returned: 0 in 1.347s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:38 devstack sudo[136333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 Jun 23 14:11:38 devstack sudo[136333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:38 devstack sudo[136333]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415" returned: 0 in 0.773s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32a7f49-444d-46fe-ac15-0fec277791fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ccfb7f5-f1ba-40f1-9455-909645b10415', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6ad3c9-02a5-4ecb-8b65-1a3bb7405df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:39 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 (1ccfb7f5-f1ba-40f1-9455-909645b10415): created successfully Jun 23 14:11:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6ad3c9-02a5-4ecb-8b65-1a3bb7405df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (e19865ba-c014-4d0c-a282-a8a4416e4877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0debea97-ac5e-495b-ab5e-328cd27eb65d tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created volume successfully. Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (f21202ae-a8ab-4cee-b282-f24bfeacf6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75743208-0891-46d1-b8e8-ef767edc6ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75743208-0891-46d1-b8e8-ef767edc6ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89029031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c75007f-0ea5-4cbb-8535-7955741900f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:41Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e78a9e-1335-441d-ae45-75b3ee91884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e78a9e-1335-441d-ae45-75b3ee91884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae534b9-bc73-4680-8549-af2bf87c73f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae534b9-bc73-4680-8549-af2bf87c73f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c75007f-0ea5-4cbb-8535-7955741900f9', 'volume_name': 'volume-0c75007f-0ea5-4cbb-8535-7955741900f9', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60df1a07-686c-4314-892a-b5ae93808ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60df1a07-686c-4314-892a-b5ae93808ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b03e39f-b2fd-4393-a3c6-9d2359b63449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:40 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume 0c75007f-0ea5-4cbb-8535-7955741900f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c75007f-0ea5-4cbb-8535-7955741900f9', 'volume_size': 1} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89029031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c75007f-0ea5-4cbb-8535-7955741900f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:41Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Creating volume 0c75007f-0ea5-4cbb-8535-7955741900f9 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:40 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:40 devstack sudo[136411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 1073741824 Jun 23 14:11:40 devstack sudo[136411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (d7e6114b-8ffd-4115-a3f5-466c85ae179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1f3b11-2ead-4287-a350-a61efa33f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1f3b11-2ead-4287-a350-a61efa33f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337387682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a44a1d-a8c9-4136-accc-0187f77e95b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:41Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7503765-24bb-4298-a9eb-0b2590205d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7503765-24bb-4298-a9eb-0b2590205d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed295e1-9250-4590-a6ca-ed1ce9c7e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed295e1-9250-4590-a6ca-ed1ce9c7e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a44a1d-a8c9-4136-accc-0187f77e95b3', 'volume_name': 'volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a7acf6-46e3-4e11-8825-57da4bce4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a7acf6-46e3-4e11-8825-57da4bce4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e58e1c-70b1-4e12-bd45-c62fa9efd49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:41 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume b5a44a1d-a8c9-4136-accc-0187f77e95b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3', 'volume_size': 1} Jun 23 14:11:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (9e8c31c9-0678-4b58-8060-ce8d0f5af947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5fc1f2-163e-4572-898f-5e059fdc1fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5fc1f2-163e-4572-898f-5e059fdc1fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800599301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80909a29-f608-4ba3-ad7d-12310218cff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:42Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda3cbbe-4a4a-45aa-946f-f08f55fd90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda3cbbe-4a4a-45aa-946f-f08f55fd90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7547a18-cc1d-4b05-a499-7a6bfc048ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7547a18-cc1d-4b05-a499-7a6bfc048ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80909a29-f608-4ba3-ad7d-12310218cff2', 'volume_name': 'volume-80909a29-f608-4ba3-ad7d-12310218cff2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e140b6-a0c9-4eec-ae9e-1255c2d6b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e140b6-a0c9-4eec-ae9e-1255c2d6b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f10cb37-6345-40d9-b504-b4e306d3c6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:42 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume 80909a29-f608-4ba3-ad7d-12310218cff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80909a29-f608-4ba3-ad7d-12310218cff2', 'volume_size': 1} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:42 devstack sudo[136411]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 1073741824" returned: 0 in 1.708s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:42 devstack sudo[136476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 Jun 23 14:11:42 devstack sudo[136476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (3b27f7f8-70a7-4c44-9a3f-6c2eee2845af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a9df6-45c2-4d3b-a300-6f9ba90b8144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a9df6-45c2-4d3b-a300-6f9ba90b8144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281741994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a5ff43-ef46-4247-94d2-ab80f256a8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:43Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9246c3e3-c5ec-4415-b701-d1a7769e28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9246c3e3-c5ec-4415-b701-d1a7769e28d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aabfb3b-e526-48ef-94d8-0af4d392dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aabfb3b-e526-48ef-94d8-0af4d392dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a5ff43-ef46-4247-94d2-ab80f256a8a2', 'volume_name': 'volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ac831c-c742-4b57-a88b-da6b17b81702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ac831c-c742-4b57-a88b-da6b17b81702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b3f7ea-f3aa-4af5-824a-e3860b4379e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume 64a5ff43-ef46-4247-94d2-ab80f256a8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2', 'volume_size': 1} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (7bb66cb8-e3aa-4df5-b14a-3dba75d69f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf1871c-a479-4388-b6da-3a41fcd4dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf1871c-a479-4388-b6da-3a41fcd4dea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-631088059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f390522c-c65f-412b-9233-8bc86f906078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:43Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831d7dc7-2934-4ce7-9aee-1beee83a5953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831d7dc7-2934-4ce7-9aee-1beee83a5953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a9d287-c83a-422c-8206-63b8f0bca6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a9d287-c83a-422c-8206-63b8f0bca6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f390522c-c65f-412b-9233-8bc86f906078', 'volume_name': 'volume-f390522c-c65f-412b-9233-8bc86f906078', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfb20e2-a33b-4d4f-a204-d113df5c60b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfb20e2-a33b-4d4f-a204-d113df5c60b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd5f582-49e7-42dc-bb23-c05bf282dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume f390522c-c65f-412b-9233-8bc86f906078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f390522c-c65f-412b-9233-8bc86f906078', 'volume_size': 1} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:43 devstack sudo[136476]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9" returned: 0 in 1.273s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] <== create_volume: return (3074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.077s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.139s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337387682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a44a1d-a8c9-4136-accc-0187f77e95b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:41Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Creating volume b5a44a1d-a8c9-4136-accc-0187f77e95b3 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:43 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b03e39f-b2fd-4393-a3c6-9d2359b63449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c75007f-0ea5-4cbb-8535-7955741900f9', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack sudo[136551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 1073741824 Jun 23 14:11:43 devstack sudo[136551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d58dbc3-9938-438b-be1c-a5c3a7a89f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:43 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume volume-0c75007f-0ea5-4cbb-8535-7955741900f9 (0c75007f-0ea5-4cbb-8535-7955741900f9): created successfully Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d58dbc3-9938-438b-be1c-a5c3a7a89f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (f21202ae-a8ab-4cee-b282-f24bfeacf6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:44 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-cd5523bb-da38-4d83-8947-c9b98e6496a1 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created volume successfully. Jun 23 14:11:45 devstack sudo[136551]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 1073741824" returned: 0 in 1.376s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:45 devstack sudo[136603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 Jun 23 14:11:45 devstack sudo[136603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:46 devstack sudo[136603]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3" returned: 0 in 0.784s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.893s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1800599301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80909a29-f608-4ba3-ad7d-12310218cff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:42Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Creating volume 80909a29-f608-4ba3-ad7d-12310218cff2 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:46 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e58e1c-70b1-4e12-bd45-c62fa9efd49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:46 devstack sudo[136631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 1073741824 Jun 23 14:11:46 devstack sudo[136631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f4c5b3-2c05-4357-9a69-bd189ff9244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 (b5a44a1d-a8c9-4136-accc-0187f77e95b3): created successfully Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f4c5b3-2c05-4357-9a69-bd189ff9244c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (d7e6114b-8ffd-4115-a3f5-466c85ae179c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ccbe7886-03bb-4fec-a6c2-b0257a66b187 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created volume successfully. Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Flow 'volume_create_manager' (9acfd2a2-fd28-4e64-8f6f-c9c6db7613cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d68ac1c-9bcd-4ef9-807c-3d19355e8ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d68ac1c-9bcd-4ef9-807c-3d19355e8ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1316252338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1137dccf-5368-4e74-976a-fbee5c080060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f170d55725b4be4a0970ca46a1837cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:47Z,use_quota=True,user_id='c0ebb48ea8784b39b02645c4c71c3cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea43f57-20bd-4504-8233-3da2f28b6302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea43f57-20bd-4504-8233-3da2f28b6302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cbbb66-c6ce-48bb-9da1-a29f9226c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cbbb66-c6ce-48bb-9da1-a29f9226c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1137dccf-5368-4e74-976a-fbee5c080060', 'volume_name': 'volume-1137dccf-5368-4e74-976a-fbee5c080060', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0447a918-4473-4690-a6cc-fe4329627661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0447a918-4473-4690-a6cc-fe4329627661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14aea3b-1c61-4b40-98c1-8e4f3fc4390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:47 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Volume 1137dccf-5368-4e74-976a-fbee5c080060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1137dccf-5368-4e74-976a-fbee5c080060', 'volume_size': 1} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:47 devstack sudo[136631]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 1073741824" returned: 0 in 1.125s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:47 devstack sudo[136673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 Jun 23 14:11:47 devstack sudo[136673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:47 devstack sudo[136673]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2" returned: 0 in 0.688s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.875s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281741994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a5ff43-ef46-4247-94d2-ab80f256a8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:43Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Creating volume 64a5ff43-ef46-4247-94d2-ab80f256a8a2 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:48 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:48 devstack sudo[136697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 1073741824 Jun 23 14:11:48 devstack sudo[136697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f10cb37-6345-40d9-b504-b4e306d3c6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80909a29-f608-4ba3-ad7d-12310218cff2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69373f74-76b0-4fc4-98df-0b091f936a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:48 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume volume-80909a29-f608-4ba3-ad7d-12310218cff2 (80909a29-f608-4ba3-ad7d-12310218cff2): created successfully Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69373f74-76b0-4fc4-98df-0b091f936a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (9e8c31c9-0678-4b58-8060-ce8d0f5af947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e34fc60f-3bfb-41cc-9594-111b693d52eb tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created volume successfully. Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Flow 'volume_create_manager' (1ab20cf6-5fb5-4f06-a32a-d36ae6078a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f029f3a-00e0-4345-b225-3461603ea828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f029f3a-00e0-4345-b225-3461603ea828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1348641128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c65887-6fba-4d2f-864e-d90734e561c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419a50a429c4b6eac44d8f3d9fbf7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:48Z,use_quota=True,user_id='9371d17f12ef4051920e3d80de0dd975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3a2ddc-f64f-46c3-9e56-52e533c4a452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3a2ddc-f64f-46c3-9e56-52e533c4a452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda30e0-12ff-4600-905f-072261aefd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda30e0-12ff-4600-905f-072261aefd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c65887-6fba-4d2f-864e-d90734e561c9', 'volume_name': 'volume-e2c65887-6fba-4d2f-864e-d90734e561c9', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e0abfb-766e-4dec-bb07-f82ceb2563d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e0abfb-766e-4dec-bb07-f82ceb2563d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493581b6-a18d-4dc6-95a5-d3a2e107e6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:48 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Volume e2c65887-6fba-4d2f-864e-d90734e561c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c65887-6fba-4d2f-864e-d90734e561c9', 'volume_size': 1} Jun 23 14:11:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:48 devstack sudo[136697]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 1073741824" returned: 0 in 1.000s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:49 devstack sudo[136733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 Jun 23 14:11:49 devstack sudo[136733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:49 devstack sudo[136733]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2" returned: 0 in 0.689s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.183s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-631088059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f390522c-c65f-412b-9233-8bc86f906078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11101f2edd04a3b8f05dbf9fc212db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:43Z,use_quota=True,user_id='00a8fe1ad8344e2a87c88157e0768deb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Creating volume f390522c-c65f-412b-9233-8bc86f906078 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:49 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:49 devstack sudo[136760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 1073741824 Jun 23 14:11:49 devstack sudo[136760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b3f7ea-f3aa-4af5-824a-e3860b4379e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b14c6f5-c940-458f-b7f0-7fc3e230bf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:49 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 (64a5ff43-ef46-4247-94d2-ab80f256a8a2): created successfully Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b14c6f5-c940-458f-b7f0-7fc3e230bf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (3b27f7f8-70a7-4c44-9a3f-6c2eee2845af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:49 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-abe3cb7e-4472-420d-a478-7ce7b25d56af tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created volume successfully. Jun 23 14:11:50 devstack sudo[136760]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 1073741824" returned: 0 in 1.100s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:50 devstack sudo[136799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 Jun 23 14:11:50 devstack sudo[136799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:51 devstack sudo[136799]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078" returned: 0 in 0.712s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.555s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1316252338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1137dccf-5368-4e74-976a-fbee5c080060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f170d55725b4be4a0970ca46a1837cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:47Z,use_quota=True,user_id='c0ebb48ea8784b39b02645c4c71c3cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Creating volume 1137dccf-5368-4e74-976a-fbee5c080060 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:51 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd5f582-49e7-42dc-bb23-c05bf282dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f390522c-c65f-412b-9233-8bc86f906078', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:51 devstack sudo[136826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 1073741824 Jun 23 14:11:51 devstack sudo[136826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1f1610-9e3c-4ffa-91a0-afbb18f12dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:51 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Volume volume-f390522c-c65f-412b-9233-8bc86f906078 (f390522c-c65f-412b-9233-8bc86f906078): created successfully Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1f1610-9e3c-4ffa-91a0-afbb18f12dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:51 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Flow 'volume_create_manager' (7bb66cb8-e3aa-4df5-b14a-3dba75d69f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ba8984ac-ae2c-44dd-8a90-62c6e449bd70 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created volume successfully. Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-f390522c-c65f-412b-9233-8bc86f906078-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-f390522c-c65f-412b-9233-8bc86f906078-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:52 devstack sudo[136826]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 1073741824" returned: 0 in 0.916s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-quobyte-f390522c-c65f-412b-9233-8bc86f906078" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-f390522c-c65f-412b-9233-8bc86f906078" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:52 devstack sudo[136859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 Jun 23 14:11:52 devstack sudo[136859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6b1001-3f54-43d2-b8f5-066d87cbb6ec]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:52 devstack sudo[136864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 Jun 23 14:11:52 devstack sudo[136864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:53 devstack sudo[136859]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060" returned: 0 in 0.752s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.903s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1348641128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c65887-6fba-4d2f-864e-d90734e561c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419a50a429c4b6eac44d8f3d9fbf7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:48Z,use_quota=True,user_id='9371d17f12ef4051920e3d80de0dd975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Creating volume e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:53 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14aea3b-1c61-4b40-98c1-8e4f3fc4390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1137dccf-5368-4e74-976a-fbee5c080060', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3974ac5-d987-4cf9-ad6e-13902cc8b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:53 devstack sudo[136888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 1073741824 Jun 23 14:11:53 devstack sudo[136888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:53 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Volume volume-1137dccf-5368-4e74-976a-fbee5c080060 (1137dccf-5368-4e74-976a-fbee5c080060): created successfully Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3974ac5-d987-4cf9-ad6e-13902cc8b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Flow 'volume_create_manager' (9acfd2a2-fd28-4e64-8f6f-c9c6db7613cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-54c880b0-a558-479c-a250-47f390986312 tempest-VolumesServicesTestJSON-1341046746 None] Created volume successfully. Jun 23 14:11:53 devstack sudo[136864]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078" returned: 0 in 1.004s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:53 devstack sudo[136903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078 Jun 23 14:11:53 devstack sudo[136903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:54 devstack sudo[136888]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 1073741824" returned: 0 in 1.113s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:54 devstack sudo[136903]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f390522c-c65f-412b-9233-8bc86f906078" returned: 0 in 0.951s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:54 devstack sudo[136937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:11:54 devstack sudo[136937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-f390522c-c65f-412b-9233-8bc86f906078" released by "delete_volume" :: held 2.021s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created reservations ['f5b1c2e6-f9eb-4fe7-9c5f-10b7565ae7bc', '0d555f17-0c7e-4f77-86b6-3aeea6b76be0', '48b5ee35-fc41-4bd1-ae1f-089d7941dcbf', 'b2cd102b-5a08-4536-bd54-a39f0a9b28ee'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Acquiring lock "cinder-1137dccf-5368-4e74-976a-fbee5c080060-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Lock "cinder-1137dccf-5368-4e74-976a-fbee5c080060-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:54 devstack sudo[136948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:54 devstack sudo[136948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Acquiring lock "cinder-quobyte-1137dccf-5368-4e74-976a-fbee5c080060" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Lock "cinder-quobyte-1137dccf-5368-4e74-976a-fbee5c080060" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab848e2e-9604-4e63-b94f-0344de30f5dc]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:55 devstack sudo[136953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 Jun 23 14:11:55 devstack sudo[136953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:55 devstack sudo[136937]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 1.345s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.553s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493581b6-a18d-4dc6-95a5-d3a2e107e6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c65887-6fba-4d2f-864e-d90734e561c9', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80289ddd-fd08-442a-9dcf-b72b451cdc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:55 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-64a5ff43-ef46-4247-94d2-ab80f256a8a2-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:56 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Volume volume-e2c65887-6fba-4d2f-864e-d90734e561c9 (e2c65887-6fba-4d2f-864e-d90734e561c9): created successfully Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80289ddd-fd08-442a-9dcf-b72b451cdc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Flow 'volume_create_manager' (1ab20cf6-5fb5-4f06-a32a-d36ae6078a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-64a5ff43-ef46-4247-94d2-ab80f256a8a2-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-945364b5-debb-40b1-aadf-485421fa8c3f tempest-TestStampPattern-1281480901 None] Created volume successfully. Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-quobyte-64a5ff43-ef46-4247-94d2-ab80f256a8a2" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-64a5ff43-ef46-4247-94d2-ab80f256a8a2" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5edba-6147-4775-8074-851827ad70af]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:56 devstack sudo[136948]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.540s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Deleted volume successfully. Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8a9b2584-59ae-4776-8cc9-4c67736ab8d8 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-f390522c-c65f-412b-9233-8bc86f906078-delete_volume" released by "delete_volume" :: held 3.941s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:56 devstack sudo[136998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 Jun 23 14:11:56 devstack sudo[136998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:56 devstack sudo[136953]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060" returned: 0 in 1.596s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:56 devstack sudo[137023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060 Jun 23 14:11:56 devstack sudo[137023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:57 devstack sudo[136998]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2" returned: 0 in 1.267s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:57 devstack sudo[137064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2 Jun 23 14:11:57 devstack sudo[137064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:57 devstack sudo[137023]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1137dccf-5368-4e74-976a-fbee5c080060" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Lock "cinder-quobyte-1137dccf-5368-4e74-976a-fbee5c080060" released by "delete_volume" :: held 2.621s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Created reservations ['cc38aee5-b11b-4ec1-9e25-553deae3a11a', '53d6ddfc-8dc2-4ed5-a392-90040203b669', 'ac0229a3-3d52-4a64-ab8c-12d72c724498', 'b05fce9c-d09f-4c5f-8953-3fd676857553'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:57 devstack sudo[137072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:57 devstack sudo[137072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:58 devstack sudo[137064]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-64a5ff43-ef46-4247-94d2-ab80f256a8a2" returned: 0 in 0.735s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-64a5ff43-ef46-4247-94d2-ab80f256a8a2" released by "delete_volume" :: held 2.102s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created reservations ['faf84039-3bb7-42b4-903d-16617a2ee6e4', '15f19650-64c9-4ce3-8514-6187ab051394', 'acf6363f-20eb-4cb0-a558-fc239f1c1b51', '52d5e120-c76f-45ca-acac-10df2be57158'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:58 devstack sudo[137099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:11:58 devstack sudo[137099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:58 devstack sudo[137072]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.079s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Deleted volume successfully. Jun 23 14:11:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-16d55636-03da-4fcd-8947-2fe4726572eb tempest-VolumesServicesTestJSON-1341046746 None] Lock "cinder-1137dccf-5368-4e74-976a-fbee5c080060-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:59 devstack sudo[137099]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.738s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:59 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Deleted volume successfully. Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-145ac526-0bbe-41f2-ab91-4ab914c2d631 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-64a5ff43-ef46-4247-94d2-ab80f256a8a2-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-80909a29-f608-4ba3-ad7d-12310218cff2-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-80909a29-f608-4ba3-ad7d-12310218cff2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-quobyte-80909a29-f608-4ba3-ad7d-12310218cff2" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-80909a29-f608-4ba3-ad7d-12310218cff2" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[15354653-704b-4e1b-83da-54ef51769502]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:59 devstack sudo[137133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 Jun 23 14:11:59 devstack sudo[137133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:00 devstack sudo[137133]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2" returned: 0 in 1.132s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:00 devstack sudo[137172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2 Jun 23 14:12:00 devstack sudo[137172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:01 devstack sudo[137172]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-80909a29-f608-4ba3-ad7d-12310218cff2" returned: 0 in 0.929s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-80909a29-f608-4ba3-ad7d-12310218cff2" released by "delete_volume" :: held 2.128s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created reservations ['8936b90b-2f09-41cb-ac34-4a0a50cd3286', '25dc45e2-ed67-40e4-b5f6-487ee96c077c', '29bff94a-0a37-4d52-a7da-0b9a34d1e840', '35374806-408c-43c2-a52d-7ffea696ff82'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:01 devstack sudo[137213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:01 devstack sudo[137213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:02 devstack sudo[137213]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.784s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Deleted volume successfully. Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4675aa56-518f-48b0-b8ec-096ba3003fc6 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-80909a29-f608-4ba3-ad7d-12310218cff2-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-b5a44a1d-a8c9-4136-accc-0187f77e95b3-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-b5a44a1d-a8c9-4136-accc-0187f77e95b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=102,cinder:INSERT=35,cinder:UPDATE=143,cinder:DELETE=8 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-quobyte-b5a44a1d-a8c9-4136-accc-0187f77e95b3" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-b5a44a1d-a8c9-4136-accc-0187f77e95b3" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3391c1f0-52b3-43c2-a4fc-005fb8ce6742]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:03 devstack sudo[137264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 Jun 23 14:12:03 devstack sudo[137264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:04 devstack sudo[137264]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3" returned: 0 in 1.617s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:04 devstack sudo[137385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3 Jun 23 14:12:04 devstack sudo[137385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:05 devstack sudo[137385]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b5a44a1d-a8c9-4136-accc-0187f77e95b3" returned: 0 in 0.947s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-b5a44a1d-a8c9-4136-accc-0187f77e95b3" released by "delete_volume" :: held 2.641s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=97,cinder:INSERT=34,cinder:UPDATE=147,cinder:DELETE=18 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created reservations ['d10cb79a-0386-488b-9578-32cfc6176748', '34b394d7-a770-47ff-be8c-8b7dbb25c088', '08a22ec3-4b40-4df6-8237-9d0c2a569626', '11187773-7c55-4308-8c14-3a5366ab91e3'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:05 devstack sudo[137427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:05 devstack sudo[137427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-0c75007f-0ea5-4cbb-8535-7955741900f9-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-0c75007f-0ea5-4cbb-8535-7955741900f9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-quobyte-0c75007f-0ea5-4cbb-8535-7955741900f9" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-0c75007f-0ea5-4cbb-8535-7955741900f9" acquired by "delete_volume" :: waited 0.064s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0661d830-66ab-4112-8bc1-8e09b53cfb99]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:06 devstack sudo[137461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 Jun 23 14:12:06 devstack sudo[137461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Flow 'volume_create_manager' (db7bb9ee-e0aa-4578-9147-2d153faae795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4340e9-a87c-401b-95c8-4f788fcf0de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4340e9-a87c-401b-95c8-4f788fcf0de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-216206925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106d5801-9977-4c9d-a54f-231b8663a171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2c7d3d774240b3b9d65619d6b4559a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:07Z,use_quota=True,user_id='cfe7a59d216e4e0aae12aeee3aef5fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910697cd-a79b-42db-a56d-5cbc421180dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910697cd-a79b-42db-a56d-5cbc421180dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0beb7e-e0ee-4429-a9f7-62361b340287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0beb7e-e0ee-4429-a9f7-62361b340287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106d5801-9977-4c9d-a54f-231b8663a171', 'volume_name': 'volume-106d5801-9977-4c9d-a54f-231b8663a171', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331581c7-5289-4092-af60-825ee4ebe1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331581c7-5289-4092-af60-825ee4ebe1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a8171c-ea0e-4640-8562-c675c20cf8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:07 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Volume 106d5801-9977-4c9d-a54f-231b8663a171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106d5801-9977-4c9d-a54f-231b8663a171', 'volume_size': 1} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-216206925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106d5801-9977-4c9d-a54f-231b8663a171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2c7d3d774240b3b9d65619d6b4559a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:07Z,use_quota=True,user_id='cfe7a59d216e4e0aae12aeee3aef5fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Creating volume 106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:12:07 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:07 devstack sudo[137477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 1073741824 Jun 23 14:12:07 devstack sudo[137477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:07 devstack sudo[137427]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.479s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:07 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Deleted volume successfully. Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-dd9f0c59-96f4-41f9-af50-f1feb3bb3284 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-b5a44a1d-a8c9-4136-accc-0187f77e95b3-delete_volume" released by "delete_volume" :: held 4.532s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:07 devstack sudo[137461]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9" returned: 0 in 1.261s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:07 devstack sudo[137507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9 Jun 23 14:12:07 devstack sudo[137507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:08 devstack sudo[137477]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 1073741824" returned: 0 in 1.302s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:08 devstack sudo[137529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 Jun 23 14:12:08 devstack sudo[137529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:08 devstack sudo[137507]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0c75007f-0ea5-4cbb-8535-7955741900f9" returned: 0 in 0.966s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-0c75007f-0ea5-4cbb-8535-7955741900f9" released by "delete_volume" :: held 2.328s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created reservations ['5cc2dc74-1e59-4f4c-ad12-e716a484c8c6', '0457ab55-474f-467a-88a7-c940594e55c0', 'de62b179-c0b6-417d-9d95-26317d8a10ad', 'd52047ff-d2d3-4ac1-95ac-874479f4b76b'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:09 devstack sudo[137553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:09 devstack sudo[137553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:09 devstack sudo[137529]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171" returned: 0 in 0.984s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.368s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a8171c-ea0e-4640-8562-c675c20cf8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106d5801-9977-4c9d-a54f-231b8663a171', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adae037-41ae-46ed-b019-19f0fb3c2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Volume volume-106d5801-9977-4c9d-a54f-231b8663a171 (106d5801-9977-4c9d-a54f-231b8663a171): created successfully Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4adae037-41ae-46ed-b019-19f0fb3c2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Flow 'volume_create_manager' (db7bb9ee-e0aa-4578-9147-2d153faae795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8bd01992-bae8-458c-b3ed-0d6cfa5a8010 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Created volume successfully. Jun 23 14:12:09 devstack sudo[137553]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.767s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-1ccfb7f5-f1ba-40f1-9455-909645b10415-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Deleted volume successfully. Jun 23 14:12:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-1ccfb7f5-f1ba-40f1-9455-909645b10415-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3eee2e3a-6076-4217-b0c5-bf00d3f1013b tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-0c75007f-0ea5-4cbb-8535-7955741900f9-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "cinder-quobyte-1ccfb7f5-f1ba-40f1-9455-909645b10415" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-1ccfb7f5-f1ba-40f1-9455-909645b10415" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb294610-ca49-4958-b449-52f5c70ea038]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:10 devstack sudo[137587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 Jun 23 14:12:10 devstack sudo[137587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Creating offline snapshot a8f4ab89-36c7-4df4-b552-66c07cd4bd67 of volume 106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fede233a-31bc-4404-a043-d6f632324a5a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:10 devstack sudo[137605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 Jun 23 14:12:10 devstack sudo[137605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:11 devstack sudo[137587]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415" returned: 0 in 1.208s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:11 devstack sudo[137632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415 Jun 23 14:12:11 devstack sudo[137632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:11 devstack sudo[137605]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171" returned: 0 in 0.970s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:11 devstack sudo[137643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 1G Jun 23 14:12:11 devstack sudo[137643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:12 devstack sudo[137632]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1ccfb7f5-f1ba-40f1-9455-909645b10415" returned: 0 in 0.794s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-quobyte-1ccfb7f5-f1ba-40f1-9455-909645b10415" released by "delete_volume" :: held 2.053s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Created reservations ['7067238f-1b6b-4ca8-a66e-fbd81a5fee6e', '66812e39-0989-4441-b874-bad7247f6ba0', 'eabe0b7e-1bb0-41e9-8490-d8038ed1af99', 'ef26efad-8012-427f-9e75-3ec3fb464fdd'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:12 devstack sudo[137673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:12 devstack sudo[137673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:12 devstack sudo[137643]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 1G" returned: 0 in 0.990s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106d5801-9977-4c9d-a54f-231b8663a171 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:12 devstack sudo[137682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106d5801-9977-4c9d-a54f-231b8663a171 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 Jun 23 14:12:12 devstack sudo[137682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:13 devstack sudo[137673]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.696s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:13 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Deleted volume successfully. Jun 23 14:12:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-6331ee2f-b197-4726-aa7f-5bf0a6015954 tempest-CreateVolumesFromSourceVolumeTest-1064169969 None] Lock "cinder-1ccfb7f5-f1ba-40f1-9455-909645b10415-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:13 devstack sudo[137682]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106d5801-9977-4c9d-a54f-231b8663a171 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67" returned: 0 in 0.800s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:13 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 is being set with open permissions: ugo+rw Jun 23 14:12:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:13 devstack sudo[137713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 Jun 23 14:12:13 devstack sudo[137713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:14 devstack sudo[137713]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67" returned: 0 in 0.730s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:14 devstack sudo[137740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info Jun 23 14:12:14 devstack sudo[137740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:14 devstack sudo[137740]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info" returned: 0 in 0.759s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:14 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info is being set with open permissions: ugo+rw Jun 23 14:12:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:14 devstack sudo[137766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info Jun 23 14:12:14 devstack sudo[137766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:15 devstack sudo[137766]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.info" returned: 0 in 0.673s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.059s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-415fbc65-cb3e-40f7-959d-8dee7d2241bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Create snapshot completed successfully Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "cinder-a8f4ab89-36c7-4df4-b552-66c07cd4bd67-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-a8f4ab89-36c7-4df4-b552-66c07cd4bd67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "cinder-quobyte-106d5801-9977-4c9d-a54f-231b8663a171" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-quobyte-106d5801-9977-4c9d-a54f-231b8663a171" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "cinder-quobyte-a8f4ab89-36c7-4df4-b552-66c07cd4bd67" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-quobyte-a8f4ab89-36c7-4df4-b552-66c07cd4bd67" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Deleting offline snapshot a8f4ab89-36c7-4df4-b552-66c07cd4bd67 of volume 106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] snapshot_file for this snap is: volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b9b64-0a17-470c-a2d1-828efc7210b8]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:17 devstack sudo[137843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 Jun 23 14:12:17 devstack sudo[137843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:18 devstack sudo[137843]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67" returned: 0 in 0.842s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106d5801-9977-4c9d-a54f-231b8663a171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:12:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df43347-640c-486d-8968-5913840f2c9c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:18 devstack sudo[137894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 Jun 23 14:12:18 devstack sudo[137894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:19 devstack sudo[137894]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171" returned: 0 in 0.810s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:19 devstack sudo[137924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 Jun 23 14:12:19 devstack sudo[137924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:19 devstack sudo[137924]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67" returned: 0 in 0.765s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:19 devstack sudo[137950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67 Jun 23 14:12:19 devstack sudo[137950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:20 devstack sudo[137950]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171.a8f4ab89-36c7-4df4-b552-66c07cd4bd67" returned: 0 in 0.682s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-quobyte-a8f4ab89-36c7-4df4-b552-66c07cd4bd67" released by "_delete_snapshot" :: held 3.208s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-quobyte-106d5801-9977-4c9d-a54f-231b8663a171" released by "delete_snapshot" :: held 3.236s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:20 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Created reservations ['1f2bf836-74bd-415b-931b-e9ec224d7700', 'db90ccd1-30f9-470f-8987-76ca558d68e5', '7ee7ca7e-9cf3-4f9f-bd0c-de73b9ae19a1', 'a3faf028-e2e6-42da-9d31-7bd7180d0d7b'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Delete snapshot completed successfully. Jun 23 14:12:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4a03b494-854c-449d-9392-f7a560a1919e tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-a8f4ab89-36c7-4df4-b552-66c07cd4bd67-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "cinder-106d5801-9977-4c9d-a54f-231b8663a171-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-106d5801-9977-4c9d-a54f-231b8663a171-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "cinder-quobyte-106d5801-9977-4c9d-a54f-231b8663a171" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-quobyte-106d5801-9977-4c9d-a54f-231b8663a171" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[71368c73-5057-47f8-bd8c-0c9cefd0c6d0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:21 devstack sudo[138010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 Jun 23 14:12:21 devstack sudo[138010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:22 devstack sudo[138010]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171" returned: 0 in 0.813s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:22 devstack sudo[138039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171 Jun 23 14:12:22 devstack sudo[138039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:23 devstack sudo[138039]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-106d5801-9977-4c9d-a54f-231b8663a171" returned: 0 in 0.649s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-quobyte-106d5801-9977-4c9d-a54f-231b8663a171" released by "delete_volume" :: held 1.525s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Created reservations ['d2c19314-6949-4557-a11d-bed09e25032b', 'b341b547-6c15-4662-9017-2f4008432253', 'b23f62dc-2c69-4b04-896f-71ddeda59ada', '043ee8a4-804a-4f3e-83bb-11b409bc7496'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:23 devstack sudo[138066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:23 devstack sudo[138066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:24 devstack sudo[138066]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.713s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:24 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:24 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Deleted volume successfully. Jun 23 14:12:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-38573267-7cc5-4a7b-a62e-1da518ebd817 tempest-VolumeSnapshotQuotasNegativeTestJSON-1237917951 None] Lock "cinder-106d5801-9977-4c9d-a54f-231b8663a171-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Flow 'volume_create_manager' (f8cad4a9-b3b2-4dd3-9cf6-1c61b90e62e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4129e032-4791-4a84-a743-209d5eaa67e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4129e032-4791-4a84-a743-209d5eaa67e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-155461545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4b8707-788d-49f5-9689-52986bbaf54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce4145687f14019be28985f299d4086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:31Z,use_quota=True,user_id='653089107296419d8b9aed529797351f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c8ec43-0c26-4bef-9162-f31d4b74cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c8ec43-0c26-4bef-9162-f31d4b74cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b07e51-76ab-4285-863f-63519e87a372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b07e51-76ab-4285-863f-63519e87a372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba4b8707-788d-49f5-9689-52986bbaf54b', 'volume_name': 'volume-ba4b8707-788d-49f5-9689-52986bbaf54b', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d90dd6-5e1a-43b8-9c38-4565305d57af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d90dd6-5e1a-43b8-9c38-4565305d57af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a2abd0-185e-4c58-a326-4926e549a2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Volume ba4b8707-788d-49f5-9689-52986bbaf54b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba4b8707-788d-49f5-9689-52986bbaf54b', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:12:31 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Trying to clone ba4b8707-788d-49f5-9689-52986bbaf54b from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:12:32 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdefe0a9-1702-45b0-a347-473cac965880]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:32 devstack sudo[138342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD Jun 23 14:12:32 devstack sudo[138342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:32 devstack sudo[138350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:32 devstack sudo[138350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:32 devstack sudo[138342]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:32 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed is fetched for user 653089107296419d8b9aed529797351f. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea15a1d-0704-4f61-9771-259c4d6f60a3]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:33 devstack sudo[138350]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.714s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:12:33 devstack sudo[138375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD Jun 23 14:12:33 devstack sudo[138375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:33 devstack sudo[138375]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-155461545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4b8707-788d-49f5-9689-52986bbaf54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce4145687f14019be28985f299d4086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:31Z,use_quota=True,user_id='653089107296419d8b9aed529797351f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Creating volume ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:12:33 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:12:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:33 devstack sudo[138406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b 1073741824 Jun 23 14:12:33 devstack sudo[138406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:34 devstack sudo[138406]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b 1073741824" returned: 0 in 0.849s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:34 devstack sudo[138445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:34 devstack sudo[138445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:35 devstack sudo[138445]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 0 in 0.691s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.144s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[811b70c0-b55f-43cd-803d-5d2b5ba51b36]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Attempting download of 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume ba4b8707-788d-49f5-9689-52986bbaf54b. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b149414-9eab-4ae5-8088-eac0ec29e677]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:35 devstack sudo[138474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:12:35 devstack sudo[138474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:35 devstack sudo[138476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt Jun 23 14:12:35 devstack sudo[138476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:36 devstack sudo[138474]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 0.869s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-e2c65887-6fba-4d2f-864e-d90734e561c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4495ba6-f18c-426e-a6ff-a9a597680105', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:12:36 devstack sudo[138476]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt" returned: 0 in 0.843s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-e7773946-e995-4465-b724-affa4f63f799 req-17beab6f-a07a-48ee-8e57-930f07250648 tempest-TestStampPattern-1281480901 None] attachment_update completed successfully. Jun 23 14:12:36 devstack sudo[138511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt Jun 23 14:12:36 devstack sudo[138511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:37 devstack sudo[138511]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt" returned: 1 in 0.779s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_lnza7uvt' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:37 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0336b2-b26d-4169-a657-8640a629b0e5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:37 devstack sudo[138603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD Jun 23 14:12:37 devstack sudo[138603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:37 devstack sudo[138603]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:37 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] 0ba7d2d6-fbde-443c-96de-e07fd76adfed was qcow2, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:12:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:38 devstack sudo[138952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:38 devstack sudo[138952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:40 devstack sudo[138952]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 0 in 2.182s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:40 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_fx2rihtudevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:12:40 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Converted 112.00 MB image at 51.29 MB/s Jun 23 14:12:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:40 devstack sudo[139027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b 1G Jun 23 14:12:40 devstack sudo[139027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:40 devstack sudo[139027]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b 1G" returned: 0 in 0.747s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:40 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd82a43-6f15-4552-aa69-18eeca99a6bc]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:41 devstack sudo[139056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:41 devstack sudo[139056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:41 devstack sudo[139056]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 0 in 0.797s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:41 devstack sudo[139089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:41 devstack sudo[139089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:42 devstack sudo[139089]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 1 in 0.862s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Downloaded image 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume ba4b8707-788d-49f5-9689-52986bbaf54b successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed for user 653089107296419d8b9aed529797351f is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Marking volume ba4b8707-788d-49f5-9689-52986bbaf54b as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Copying metadata from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed to ba4b8707-788d-49f5-9689-52986bbaf54b. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Creating volume glance metadata for volume ba4b8707-788d-49f5-9689-52986bbaf54b backed by image 0ba7d2d6-fbde-443c-96de-e07fd76adfed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a2abd0-185e-4c58-a326-4926e549a2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4b8707-788d-49f5-9689-52986bbaf54b', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a83a750-0de5-4bc6-9753-faee801d3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:42 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Volume volume-ba4b8707-788d-49f5-9689-52986bbaf54b (ba4b8707-788d-49f5-9689-52986bbaf54b): created successfully Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a83a750-0de5-4bc6-9753-faee801d3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Flow 'volume_create_manager' (f8cad4a9-b3b2-4dd3-9cf6-1c61b90e62e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0c5db871-7ce6-4a41-a905-f1b9b427a8a9 tempest-VolumesImageMetadata-1657505324 None] Created volume successfully. Jun 23 14:12:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Acquiring lock "cinder-ba4b8707-788d-49f5-9689-52986bbaf54b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Lock "cinder-ba4b8707-788d-49f5-9689-52986bbaf54b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Acquiring lock "cinder-quobyte-ba4b8707-788d-49f5-9689-52986bbaf54b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:12:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Lock "cinder-quobyte-ba4b8707-788d-49f5-9689-52986bbaf54b" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:12:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14e3f41-9319-4b59-8680-c680765a225d]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:43 devstack sudo[139167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:43 devstack sudo[139167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:44 devstack sudo[139167]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 0 in 0.830s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:44 devstack sudo[139209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:44 devstack sudo[139209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:45 devstack sudo[139209]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 1 in 0.886s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:45 devstack sudo[139276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b Jun 23 14:12:45 devstack sudo[139276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:46 devstack sudo[139276]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ba4b8707-788d-49f5-9689-52986bbaf54b" returned: 0 in 0.711s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Lock "cinder-quobyte-ba4b8707-788d-49f5-9689-52986bbaf54b" released by "delete_volume" :: held 2.506s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Created reservations ['7effa1e7-a8c5-4435-8bcf-d4ef6e31d721', 'dbe9e96c-691f-4a53-8a15-e8177b27fcdd', '43d854eb-a8e7-4116-b71b-db281ec83b1f', 'c8f1b132-0685-4d36-9efd-cffd55f2d6ab'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:46 devstack sudo[139304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:12:46 devstack sudo[139304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-909c2544-8130-45e6-95b3-176b6e85fd5f req-5b314bf9-564b-4be6-9ab7-b4903840ddd3 tempest-TestStampPattern-1281480901 None] Terminate volume connection completed successfully. Jun 23 14:12:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-909c2544-8130-45e6-95b3-176b6e85fd5f req-5b314bf9-564b-4be6-9ab7-b4903840ddd3 tempest-TestStampPattern-1281480901 None] Deleting attachment c4495ba6-f18c-426e-a6ff-a9a597680105. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:12:47 devstack sudo[139304]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.723s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:47 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Deleted volume successfully. Jun 23 14:12:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0ddfd8a8-8444-47c5-9b43-fa64af7b50a7 tempest-VolumesImageMetadata-1657505324 None] Lock "cinder-ba4b8707-788d-49f5-9689-52986bbaf54b-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:12:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Creating offline snapshot 3e03a091-819d-4476-9000-5a6fac50017b of volume e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:12:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64bbd7-039f-42b6-9607-700a1c453a07]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:48 devstack sudo[139409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:12:48 devstack sudo[139409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:49 devstack sudo[139409]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 0.812s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:49 devstack sudo[139438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b 1G Jun 23 14:12:49 devstack sudo[139438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Flow 'volume_create_manager' (deeefcad-a54a-460c-884a-28bcf1868830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce95533e-31d1-482b-a943-cfe08fac6ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce95533e-31d1-482b-a943-cfe08fac6ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1196706907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e46ea05-69fd-4299-923b-014324d86ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ecebb3fb64ff98bfbd2bdea08213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:50Z,use_quota=True,user_id='a422472e1976435fb9240259c4c83b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a436b921-1adc-4d6c-a32c-0aa491c407d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a436b921-1adc-4d6c-a32c-0aa491c407d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3e7f97-2346-4027-b960-0e4f311b880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:12:50 devstack sudo[139438]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b 1G" returned: 0 in 0.889s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c65887-6fba-4d2f-864e-d90734e561c9 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:50 devstack sudo[139470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c65887-6fba-4d2f-864e-d90734e561c9 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b Jun 23 14:12:50 devstack sudo[139470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3e7f97-2346-4027-b960-0e4f311b880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e46ea05-69fd-4299-923b-014324d86ed4', 'volume_name': 'volume-9e46ea05-69fd-4299-923b-014324d86ed4', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a9cb61-b9fc-4d51-aecf-c111b888f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a9cb61-b9fc-4d51-aecf-c111b888f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663b218b-0bf2-44d9-ae4c-2a184977e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:50 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Volume 9e46ea05-69fd-4299-923b-014324d86ed4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e46ea05-69fd-4299-923b-014324d86ed4', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Trying to clone 9e46ea05-69fd-4299-923b-014324d86ed4 from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:12:50 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d6431-b4cd-4992-88bd-387b409ac544]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:51 devstack sudo[139489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD Jun 23 14:12:51 devstack sudo[139489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:51 devstack sudo[139470]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c65887-6fba-4d2f-864e-d90734e561c9 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b" returned: 0 in 0.832s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:51 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b is being set with open permissions: ugo+rw Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:51 devstack sudo[139503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b Jun 23 14:12:51 devstack sudo[139503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:51 devstack sudo[139489]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed is fetched for user a422472e1976435fb9240259c4c83b69. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4066640-0605-46dd-9367-40f7f6678934]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:51 devstack sudo[139503]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b" returned: 0 in 0.661s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:51 devstack sudo[139524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD Jun 23 14:12:51 devstack sudo[139524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:51 devstack sudo[139532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info Jun 23 14:12:51 devstack sudo[139532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:52 devstack sudo[139524]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:52 devstack sudo[139532]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info" returned: 0 in 0.677s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:52 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info is being set with open permissions: ugo+rw Jun 23 14:12:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:52 devstack sudo[139558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info Jun 23 14:12:52 devstack sudo[139558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:53 devstack sudo[139558]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.info" returned: 0 in 0.666s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.631s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1196706907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e46ea05-69fd-4299-923b-014324d86ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ecebb3fb64ff98bfbd2bdea08213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:50Z,use_quota=True,user_id='a422472e1976435fb9240259c4c83b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Creating volume 9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:12:53 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:12:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:53 devstack sudo[139580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 1073741824 Jun 23 14:12:53 devstack sudo[139580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:53 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2211ac0d-f84e-4106-9977-7491797f5cac tempest-TestStampPattern-1281480901 None] Create snapshot completed successfully Jun 23 14:12:54 devstack sudo[139580]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 1073741824" returned: 0 in 0.863s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:54 devstack sudo[139613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:12:54 devstack sudo[139613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:54 devstack sudo[139613]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 0 in 0.702s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Attempting download of 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume 9e46ea05-69fd-4299-923b-014324d86ed4. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab8d0e-7e61-4166-9088-8f9c3df1b918]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:55 devstack sudo[139640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4 Jun 23 14:12:55 devstack sudo[139640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:55 devstack sudo[139640]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4" returned: 0 in 0.754s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:55 devstack sudo[139668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4 Jun 23 14:12:55 devstack sudo[139668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:56 devstack sudo[139668]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4" returned: 1 in 0.777s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_nfz3wbd4' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4725099-37c1-4c9c-befe-3603e6e349da]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:56 devstack sudo[139694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD Jun 23 14:12:56 devstack sudo[139694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:57 devstack sudo[139694]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:57 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] 0ba7d2d6-fbde-443c-96de-e07fd76adfed was qcow2, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:12:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:57 devstack sudo[139723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:12:57 devstack sudo[139723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:59 devstack sudo[139723]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 0 in 2.056s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:59 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_c8k8ariqdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:12:59 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Converted 112.00 MB image at 54.43 MB/s Jun 23 14:12:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:59 devstack sudo[139825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 1G Jun 23 14:12:59 devstack sudo[139825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:00 devstack sudo[139825]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 1G" returned: 0 in 0.757s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:00 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6121ab8-45b2-43c9-9b34-e49e83bdf0a5]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:00 devstack sudo[139862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:00 devstack sudo[139862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:00 devstack sudo[139862]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 0 in 0.791s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:01 devstack sudo[139890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:01 devstack sudo[139890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:01 devstack sudo[139890]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 1 in 0.883s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Downloaded image 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume 9e46ea05-69fd-4299-923b-014324d86ed4 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed for user a422472e1976435fb9240259c4c83b69 is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Marking volume 9e46ea05-69fd-4299-923b-014324d86ed4 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Copying metadata from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed to 9e46ea05-69fd-4299-923b-014324d86ed4. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Creating volume glance metadata for volume 9e46ea05-69fd-4299-923b-014324d86ed4 backed by image 0ba7d2d6-fbde-443c-96de-e07fd76adfed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663b218b-0bf2-44d9-ae4c-2a184977e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e46ea05-69fd-4299-923b-014324d86ed4', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c8c534-35ca-4377-a01a-3cb3c125f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:01 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Volume volume-9e46ea05-69fd-4299-923b-014324d86ed4 (9e46ea05-69fd-4299-923b-014324d86ed4): created successfully Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c8c534-35ca-4377-a01a-3cb3c125f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:01 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Flow 'volume_create_manager' (deeefcad-a54a-460c-884a-28bcf1868830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f9af1696-af1c-4c28-a08a-bc9ddd3ccae0 tempest-VolumesExtendTest-696549717 None] Created volume successfully. Jun 23 14:13:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:03 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160efee-e6ae-4368-9c7e-cae9540592a4]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:03 devstack sudo[139964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:03 devstack sudo[139964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:03 devstack sudo[139964]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 0 in 0.766s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:04 devstack sudo[139991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:04 devstack sudo[139991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:04 devstack sudo[139991]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 1 in 0.916s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:13:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 2G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:04 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=77,cinder:INSERT=31,cinder:UPDATE=66,cinder:DELETE=1 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:13:04 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 2G" returned: 0 in 0.110s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.849s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Flow 'volume_create_manager' (c99914fd-f8ad-45e8-aa68-97958ee40e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afce2ff2-eb4c-4792-92c4-22b4741c7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afce2ff2-eb4c-4792-92c4-22b4741c7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-402355783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419a50a429c4b6eac44d8f3d9fbf7ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e03a091-819d-4476-9000-5a6fac50017b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:05Z,use_quota=True,user_id='9371d17f12ef4051920e3d80de0dd975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5ec429-190b-4fe9-8253-2d1bcd5ce04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5ec429-190b-4fe9-8253-2d1bcd5ce04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da86732b-f64c-411a-8504-5b3b1bd89df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da86732b-f64c-411a-8504-5b3b1bd89df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13', 'volume_name': 'volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13', 'volume_size': 1, 'snapshot_id': '3e03a091-819d-4476-9000-5a6fac50017b'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75383dca-0904-45f7-a393-acba26405449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75383dca-0904-45f7-a393-acba26405449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3da332-5ffc-4c68-923d-d8a6a66bdf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Volume 42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13', 'volume_size': 1, 'snapshot_id': '3e03a091-819d-4476-9000-5a6fac50017b'} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-quobyte-3e03a091-819d-4476-9000-5a6fac50017b-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-3e03a091-819d-4476-9000-5a6fac50017b-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Creating volume 42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 from snapshot 3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-quobyte-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:05 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-80095834-724c-4ada-8a5c-5a12f1df4179 tempest-VolumesExtendTest-696549717 None] Extend volume completed successfully. Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] snapshot: 3e03a091-819d-4476-9000-5a6fac50017b, volume: 42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b57bb9-690a-4dbb-bae0-10f0039b6a76]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:05 devstack sudo[140037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b Jun 23 14:13:05 devstack sudo[140037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-9e46ea05-69fd-4299-923b-014324d86ed4-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Lock "cinder-9e46ea05-69fd-4299-923b-014324d86ed4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=63,cinder:SELECT=59,cinder:DELETE=9,cinder:INSERT=24 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-quobyte-9e46ea05-69fd-4299-923b-014324d86ed4" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-9e46ea05-69fd-4299-923b-014324d86ed4" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1087644-6aea-4f15-8de6-5fba1a709d78]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:05 devstack sudo[140057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:05 devstack sudo[140057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:06 devstack sudo[140037]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b" returned: 0 in 1.018s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c65887-6fba-4d2f-864e-d90734e561c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7a1647-96c9-45dc-bc4b-aeac2a95996a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:06 devstack sudo[140088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:13:06 devstack sudo[140088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:06 devstack sudo[140057]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 0 in 0.933s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:06 devstack sudo[140105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:06 devstack sudo[140105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:07 devstack sudo[140088]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:07 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:13:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:07 devstack sudo[140125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 Jun 23 14:13:07 devstack sudo[140125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:07 devstack sudo[140105]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 1 in 0.901s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:13:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:07 devstack sudo[140142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4 Jun 23 14:13:07 devstack sudo[140142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:08 devstack sudo[140142]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9e46ea05-69fd-4299-923b-014324d86ed4" returned: 0 in 1.295s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-9e46ea05-69fd-4299-923b-014324d86ed4" released by "delete_volume" :: held 3.270s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Created reservations ['1da7ef0f-ad0c-4df2-824f-d5a74d99ed73', '3692404c-2c04-4270-85d6-786fa4f8a946', '52664bc3-543a-414e-9b78-a663c9670c1b', '59976dcc-b409-42b5-b629-307969c93bff'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:09 devstack sudo[140208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:13:09 devstack sudo[140208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:11 devstack sudo[140208]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.707s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Deleted volume successfully. Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-332ac253-5f49-4f42-9399-412fcd91d95e tempest-VolumesExtendTest-696549717 None] Lock "cinder-9e46ea05-69fd-4299-923b-014324d86ed4-delete_volume" released by "delete_volume" :: held 5.579s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Flow 'volume_create_manager' (23bf0cf3-3fab-459d-88d3-569881d0deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a0cb8c-8bd7-41a1-b202-41e81b4f4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a0cb8c-8bd7-41a1-b202-41e81b4f4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-942354315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff33b8d-4596-4661-bfcc-bac1a3dc594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ecebb3fb64ff98bfbd2bdea08213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:11Z,use_quota=True,user_id='a422472e1976435fb9240259c4c83b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc5a811-b429-48c5-98d5-1ab86adfd3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc5a811-b429-48c5-98d5-1ab86adfd3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45dd8d5-a682-400e-9cfe-d507bdb1ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45dd8d5-a682-400e-9cfe-d507bdb1ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff33b8d-4596-4661-bfcc-bac1a3dc594b', 'volume_name': 'volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6645a8fa-eb4c-4be6-8f34-09cbcb162c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6645a8fa-eb4c-4be6-8f34-09cbcb162c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41205636-e55f-459c-8b1b-0d98886657ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Volume dff33b8d-4596-4661-bfcc-bac1a3dc594b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b', 'volume_size': 1} Jun 23 14:13:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:13 devstack sudo[140125]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" returned: 0 in 6.718s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:14 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2081660f-fc2f-4916-8e50-eb98a8edd352]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:14 devstack sudo[140349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:13:14 devstack sudo[140349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:15 devstack sudo[140349]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 1.177s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:15 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:13:15 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Converted 1024.00 MB image at 152.40 MB/s Jun 23 14:13:15 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 is being set with open permissions: ugo+rw Jun 23 14:13:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:15 devstack sudo[140392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 Jun 23 14:13:15 devstack sudo[140392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:16 devstack sudo[140392]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" returned: 0 in 0.850s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" released by "_copy_volume_from_snapshot" :: held 10.865s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-3e03a091-819d-4476-9000-5a6fac50017b-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" released by "_create_volume_from_snapshot" :: held 10.903s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.932s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.301s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-942354315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff33b8d-4596-4661-bfcc-bac1a3dc594b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4ecebb3fb64ff98bfbd2bdea08213f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:11Z,use_quota=True,user_id='a422472e1976435fb9240259c4c83b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Creating volume dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:13:16 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:16 devstack sudo[140441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b 1073741824 Jun 23 14:13:16 devstack sudo[140441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3da332-5ffc-4c68-923d-d8a6a66bdf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13', 'volume_size': 1, 'snapshot_id': '3e03a091-819d-4476-9000-5a6fac50017b'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900e6b8d-0074-4b61-a62d-7da84cbdac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:16 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Volume volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 (42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13): created successfully Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900e6b8d-0074-4b61-a62d-7da84cbdac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Flow 'volume_create_manager' (c99914fd-f8ad-45e8-aa68-97958ee40e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1aea4707-6f0f-4f2f-8a41-c0c162c9f6f3 tempest-TestStampPattern-1281480901 None] Created volume successfully. Jun 23 14:13:16 devstack sudo[140441]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b 1073741824" returned: 0 in 0.880s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:17 devstack sudo[140483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b Jun 23 14:13:17 devstack sudo[140483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:17 devstack sudo[140483]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b" returned: 0 in 0.786s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41205636-e55f-459c-8b1b-0d98886657ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177c5c48-231c-41f7-bc33-94ab5bed6589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:17 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Volume volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b (dff33b8d-4596-4661-bfcc-bac1a3dc594b): created successfully Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177c5c48-231c-41f7-bc33-94ab5bed6589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Flow 'volume_create_manager' (23bf0cf3-3fab-459d-88d3-569881d0deca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9869f90a-f962-420b-80c1-b093553bda12 tempest-VolumesExtendTest-696549717 None] Created volume successfully. Jun 23 14:13:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Creating offline snapshot 521e66c3-be20-4082-9357-4a67bc386b6e of volume dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:13:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f593e33-165d-49aa-b8f4-7c3af7974345]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:18 devstack sudo[140528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b Jun 23 14:13:18 devstack sudo[140528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:19 devstack sudo[140528]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b" returned: 0 in 0.910s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:19 devstack sudo[140563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e 1G Jun 23 14:13:19 devstack sudo[140563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:20 devstack sudo[140563]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e 1G" returned: 0 in 0.843s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:20 devstack sudo[140596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e Jun 23 14:13:20 devstack sudo[140596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:20 devstack sudo[140596]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e" returned: 0 in 0.715s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:20 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e is being set with open permissions: ugo+rw Jun 23 14:13:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:20 devstack sudo[140628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e Jun 23 14:13:20 devstack sudo[140628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:21 devstack sudo[140628]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e" returned: 0 in 0.883s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:21 devstack sudo[140705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info Jun 23 14:13:21 devstack sudo[140705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:22 devstack sudo[140705]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info" returned: 0 in 0.719s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:22 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info is being set with open permissions: ugo+rw Jun 23 14:13:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:22 devstack sudo[140730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info Jun 23 14:13:22 devstack sudo[140730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:23 devstack sudo[140730]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.info" returned: 0 in 0.674s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-905a8cd8-1458-4816-89dc-07ad16c685c5 tempest-VolumesExtendTest-696549717 None] Create snapshot completed successfully Jun 23 14:13:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a2e9bf-3222-4bb4-bacd-a33ec3373a9b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:23 devstack sudo[140774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b Jun 23 14:13:23 devstack sudo[140774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:24 devstack sudo[140774]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b" returned: 0 in 0.953s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e 2G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e 2G" returned: 0 in 0.214s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.216s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:25 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-31c8d0fe-8a3a-4118-b221-5b9afce2c2fa tempest-VolumesExtendTest-696549717 None] Extend volume completed successfully. Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-521e66c3-be20-4082-9357-4a67bc386b6e-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Lock "cinder-521e66c3-be20-4082-9357-4a67bc386b6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-quobyte-dff33b8d-4596-4661-bfcc-bac1a3dc594b" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-dff33b8d-4596-4661-bfcc-bac1a3dc594b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-quobyte-521e66c3-be20-4082-9357-4a67bc386b6e" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-521e66c3-be20-4082-9357-4a67bc386b6e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Deleting offline snapshot 521e66c3-be20-4082-9357-4a67bc386b6e of volume dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] snapshot_file for this snap is: volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8a51a-8278-4cbe-8900-c1ff4353905e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:26 devstack sudo[140857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e Jun 23 14:13:26 devstack sudo[140857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:27 devstack sudo[140857]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e" returned: 0 in 0.833s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:13:27 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18616a4-064c-41e7-aab2-28235bb5dcca]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:27 devstack sudo[140890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b Jun 23 14:13:27 devstack sudo[140890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:27 devstack sudo[140890]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b" returned: 0 in 0.792s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:27 devstack sudo[140919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e Jun 23 14:13:27 devstack sudo[140919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:28 devstack sudo[140919]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e" returned: 0 in 0.886s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:28 devstack sudo[140948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e Jun 23 14:13:28 devstack sudo[140948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:29 devstack sudo[140948]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b.521e66c3-be20-4082-9357-4a67bc386b6e" returned: 0 in 0.691s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-521e66c3-be20-4082-9357-4a67bc386b6e" released by "_delete_snapshot" :: held 3.325s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-dff33b8d-4596-4661-bfcc-bac1a3dc594b" released by "delete_snapshot" :: held 3.361s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:29 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Created reservations ['63210322-81bb-4484-8618-2adb6a304a70', '1f68f670-74b4-4877-8da2-d7fafb07863e', 'ba754bf9-3aee-4c4a-941f-5b06a0ec5298', 'c2b4cb3f-bd4a-4347-808d-a30680e685ea'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:29 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Delete snapshot completed successfully. Jun 23 14:13:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-937540a4-3436-45a3-b67c-8be56eab3366 tempest-VolumesExtendTest-696549717 None] Lock "cinder-521e66c3-be20-4082-9357-4a67bc386b6e-delete_snapshot" released by "delete_snapshot" :: held 3.559s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-dff33b8d-4596-4661-bfcc-bac1a3dc594b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Lock "cinder-dff33b8d-4596-4661-bfcc-bac1a3dc594b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Acquiring lock "cinder-quobyte-dff33b8d-4596-4661-bfcc-bac1a3dc594b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-dff33b8d-4596-4661-bfcc-bac1a3dc594b" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:30 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3444ac67-098a-47d7-895d-06322f5991f1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:30 devstack sudo[141008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b Jun 23 14:13:30 devstack sudo[141008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:31 devstack sudo[141008]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b" returned: 0 in 0.838s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:31 devstack sudo[141037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b Jun 23 14:13:31 devstack sudo[141037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:32 devstack sudo[141037]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-dff33b8d-4596-4661-bfcc-bac1a3dc594b" returned: 0 in 0.725s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Lock "cinder-quobyte-dff33b8d-4596-4661-bfcc-bac1a3dc594b" released by "delete_volume" :: held 1.649s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Created reservations ['49082c20-cfc1-4d36-ab52-6da7ad852228', '93cebf02-58ee-467e-8ad6-0f922a112f05', '1fac0b81-a090-4e3f-bc96-7e5c74d08f33', 'cddaecc4-7043-4845-8be3-ca3e3ce97df0'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:32 devstack sudo[141067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:13:32 devstack sudo[141067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:32 devstack sudo[141072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:13:32 devstack sudo[141072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:33 devstack sudo[141067]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.880s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:13:33 devstack sudo[141072]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.941s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Deleted volume successfully. Jun 23 14:13:33 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-19362718-677d-464c-8096-042f95eb7da3 tempest-VolumesExtendTest-696549717 None] Lock "cinder-dff33b8d-4596-4661-bfcc-bac1a3dc594b-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (8bb6e967-3439-4866-b410-18c98b762767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5557eb7-ac98-4304-8d86-685fc25fe3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5557eb7-ac98-4304-8d86-685fc25fe3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1189016155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b97a49-48e1-4e7b-adb0-87373f8f2d7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:36Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edcb52f-e8c4-4032-9299-708bc1e46c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edcb52f-e8c4-4032-9299-708bc1e46c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9e241e-c0d2-487f-8f3d-77e539d8fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9e241e-c0d2-487f-8f3d-77e539d8fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b97a49-48e1-4e7b-adb0-87373f8f2d7b', 'volume_name': 'volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b710d9a0-f533-49dc-81f1-eab588180c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b710d9a0-f533-49dc-81f1-eab588180c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023dd1f8-cd1b-4f30-8821-224f9df1d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Volume 92b97a49-48e1-4e7b-adb0-87373f8f2d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b', 'volume_size': 1} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1189016155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b97a49-48e1-4e7b-adb0-87373f8f2d7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:36Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Creating volume 92b97a49-48e1-4e7b-adb0-87373f8f2d7b {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:13:36 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:13:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:36 devstack sudo[141208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b 1073741824 Jun 23 14:13:36 devstack sudo[141208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:37 devstack sudo[141208]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b 1073741824" returned: 0 in 0.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:37 devstack sudo[141241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b Jun 23 14:13:37 devstack sudo[141241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:37 devstack sudo[141241]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b" returned: 0 in 0.660s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:13:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023dd1f8-cd1b-4f30-8821-224f9df1d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1b7523-cd0a-4025-9450-e53791d85c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:38 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Volume volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b (92b97a49-48e1-4e7b-adb0-87373f8f2d7b): created successfully Jun 23 14:13:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1b7523-cd0a-4025-9450-e53791d85c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:38 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (8bb6e967-3439-4866-b410-18c98b762767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a5d20d47-e32b-4af5-9772-2e6606e817ba tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (ba1f49ff-17f4-4e26-83a1-706022649b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45db5c72-60c3-46a7-ac5c-eaf6cb530456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45db5c72-60c3-46a7-ac5c-eaf6cb530456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1123229711',display_name='tempest-VolumesGetTest-Volume-684913349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c287c77-fee6-4fce-a8b5-f41a250a5cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:39Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8375aef4-2617-4a14-828a-c6b93a8cf00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8375aef4-2617-4a14-828a-c6b93a8cf00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7f9c55-8a1c-4723-9290-68bde522c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7f9c55-8a1c-4723-9290-68bde522c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c287c77-fee6-4fce-a8b5-f41a250a5cdb', 'volume_name': 'volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b9ab09-cca6-4c78-970a-c0734bd8be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b9ab09-cca6-4c78-970a-c0734bd8be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aef9a4-a457-4fc7-86f9-f54e5f90f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:39 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Volume 9c287c77-fee6-4fce-a8b5-f41a250a5cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb', 'volume_size': 1} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1123229711',display_name='tempest-VolumesGetTest-Volume-684913349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c287c77-fee6-4fce-a8b5-f41a250a5cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:39Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Creating volume 9c287c77-fee6-4fce-a8b5-f41a250a5cdb {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:13:39 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:13:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:39 devstack sudo[141301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb 1073741824 Jun 23 14:13:39 devstack sudo[141301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:40 devstack sudo[141301]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb 1073741824" returned: 0 in 0.869s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:40 devstack sudo[141333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb Jun 23 14:13:40 devstack sudo[141333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:40 devstack sudo[141333]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb" returned: 0 in 0.667s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3aef9a4-a457-4fc7-86f9-f54e5f90f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d7ead2-e01a-4414-93dc-4eec31877183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:40 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Volume volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb (9c287c77-fee6-4fce-a8b5-f41a250a5cdb): created successfully Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d7ead2-e01a-4414-93dc-4eec31877183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:40 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (ba1f49ff-17f4-4e26-83a1-706022649b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:40 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-65834605-b041-407e-9f05-f811ac52f6c9 tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:13:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-9c287c77-fee6-4fce-a8b5-f41a250a5cdb-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Lock "cinder-9c287c77-fee6-4fce-a8b5-f41a250a5cdb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-9c287c77-fee6-4fce-a8b5-f41a250a5cdb" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-9c287c77-fee6-4fce-a8b5-f41a250a5cdb" acquired by "delete_volume" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:41 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68491a-2634-4b53-88ae-1d20ab5ce298]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:41 devstack sudo[141375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb Jun 23 14:13:41 devstack sudo[141375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:42 devstack sudo[141375]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb" returned: 0 in 0.799s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:42 devstack sudo[141404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb Jun 23 14:13:42 devstack sudo[141404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:42 devstack sudo[141404]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9c287c77-fee6-4fce-a8b5-f41a250a5cdb" returned: 0 in 0.673s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-9c287c77-fee6-4fce-a8b5-f41a250a5cdb" released by "delete_volume" :: held 1.515s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Created reservations ['5cd8b58a-5a53-419b-8c3c-0dcfa38b4470', '756ea1c3-700f-4ec9-b2ee-a8a59e03ccbb', 'f9134129-47b6-4d4c-a363-3c59420cc119', '01bc1098-1980-4e4c-8df5-c6dff9a2ebc9'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:43 devstack sudo[141434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:13:43 devstack sudo[141434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-92b97a49-48e1-4e7b-adb0-87373f8f2d7b-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Lock "cinder-92b97a49-48e1-4e7b-adb0-87373f8f2d7b-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-92b97a49-48e1-4e7b-adb0-87373f8f2d7b" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-92b97a49-48e1-4e7b-adb0-87373f8f2d7b" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:43 devstack sudo[141434]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.725s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:43 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff6c6d3-2756-4557-a9a0-379dea8058ff]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b0d516e8-0655-4cde-ba2e-2bf99e4001a0 tempest-VolumesGetTest-1622103403 None] Lock "cinder-9c287c77-fee6-4fce-a8b5-f41a250a5cdb-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:43 devstack sudo[141459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b Jun 23 14:13:43 devstack sudo[141459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:44 devstack sudo[141459]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b" returned: 0 in 0.824s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:44 devstack sudo[141489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b Jun 23 14:13:44 devstack sudo[141489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:45 devstack sudo[141489]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b97a49-48e1-4e7b-adb0-87373f8f2d7b" returned: 0 in 0.803s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-92b97a49-48e1-4e7b-adb0-87373f8f2d7b" released by "delete_volume" :: held 1.677s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Created reservations ['d19088dc-2c78-48a5-9bef-0066181a06e8', '195a180e-6078-48a2-b9a3-c5122ed22763', '4e207334-5381-4d6d-8f48-34f51d94aa2b', 'ae8930f1-2b6a-4b83-b464-b0a4923e0b26'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:45 devstack sudo[141571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:13:45 devstack sudo[141571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:46 devstack sudo[141571]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.823s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (7f8689e2-1811-47c6-9ebc-c53c3f84b381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ac7378-4cfb-4e73-8527-95cc7d200f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ac7378-4cfb-4e73-8527-95cc7d200f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1018596858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5affd07f-4f60-4ed6-9d06-f2a807ad7fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:46Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee3db99-22ea-4668-a0df-4eaaed362365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee3db99-22ea-4668-a0df-4eaaed362365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1abd20c-8dca-46d8-a2c0-e76f7be695c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1abd20c-8dca-46d8-a2c0-e76f7be695c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'volume_name': 'volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bb07a9-dada-4bfc-b0c1-b28bc772fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bb07a9-dada-4bfc-b0c1-b28bc772fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0989dc-70b2-48c3-ab39-e3ae9c1cdd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Volume 5affd07f-4f60-4ed6-9d06-f2a807ad7fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'volume_size': 1} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1018596858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5affd07f-4f60-4ed6-9d06-f2a807ad7fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:46Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Creating volume 5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:13:46 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-bf47935c-d9da-4332-8a8d-9942c46803ce tempest-VolumesGetTest-1622103403 None] Lock "cinder-92b97a49-48e1-4e7b-adb0-87373f8f2d7b-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:46 devstack sudo[141603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 1073741824 Jun 23 14:13:46 devstack sudo[141603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:47 devstack sudo[141603]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 1073741824" returned: 0 in 0.979s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:47 devstack sudo[141641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:13:47 devstack sudo[141641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:48 devstack sudo[141641]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.680s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0989dc-70b2-48c3-ab39-e3ae9c1cdd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c485b81-4e70-4198-a1f4-186007998137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:48 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Volume volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 (5affd07f-4f60-4ed6-9d06-f2a807ad7fb8): created successfully Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c485b81-4e70-4198-a1f4-186007998137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (7f8689e2-1811-47c6-9ebc-c53c3f84b381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-584cdf96-f742-4e99-aca8-effabfb9bbaf tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (4de3328d-954e-4119-8a56-5385b3dd7f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dfbd81-88eb-4282-a897-354bcdb8af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dfbd81-88eb-4282-a897-354bcdb8af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1127674852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3d53ce-7a3e-4687-83ca-069b07dd4f97,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5affd07f-4f60-4ed6-9d06-f2a807ad7fb8,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:49Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd64c207-0cbe-4a78-b8ac-c1d9d3244ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd64c207-0cbe-4a78-b8ac-c1d9d3244ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59a5494-a83c-495e-9790-f679bcdaf6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59a5494-a83c-495e-9790-f679bcdaf6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8a3d53ce-7a3e-4687-83ca-069b07dd4f97', 'volume_name': 'volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97', 'volume_size': 1, 'source_volid': '5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'source_volstatus': 'available'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0c2963-9e0e-4f7e-8433-e72a7d2c7ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0c2963-9e0e-4f7e-8433-e72a7d2c7ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58d3a0-a1e7-4223-94af-d7a0bd86d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:49 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Volume 8a3d53ce-7a3e-4687-83ca-069b07dd4f97: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97', 'volume_size': 1, 'source_volid': '5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'source_volstatus': 'available'} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:49 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Cloning volume 5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 to volume 8a3d53ce-7a3e-4687-83ca-069b07dd4f97 Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Creating offline snapshot 1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 of volume 5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e99c88b-fe6e-4582-abd3-36081c3ec642]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:49 devstack sudo[141694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:13:49 devstack sudo[141694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:50 devstack sudo[141694]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.779s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:50 devstack sudo[141721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 1G Jun 23 14:13:50 devstack sudo[141721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:50 devstack sudo[141721]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 1G" returned: 0 in 0.866s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:51 devstack sudo[141754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 Jun 23 14:13:51 devstack sudo[141754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:51 devstack sudo[141754]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" returned: 0 in 0.739s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:51 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 is being set with open permissions: ugo+rw Jun 23 14:13:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:51 devstack sudo[141781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 Jun 23 14:13:51 devstack sudo[141781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:52 devstack sudo[141781]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" returned: 0 in 0.671s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:52 devstack sudo[141805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info Jun 23 14:13:52 devstack sudo[141805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:53 devstack sudo[141805]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info" returned: 0 in 0.679s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:53 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info is being set with open permissions: ugo+rw Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:53 devstack sudo[141829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info Jun 23 14:13:53 devstack sudo[141829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:53 devstack sudo[141829]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.info" returned: 0 in 0.654s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] snapshot: 1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52, volume: 8a3d53ce-7a3e-4687-83ca-069b07dd4f97, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d771657-7764-45c1-883a-6e81e7f2bbfc]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:53 devstack sudo[141853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 Jun 23 14:13:53 devstack sudo[141853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:54 devstack sudo[141853]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" returned: 0 in 0.822s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:13:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:13:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:13:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1db365-5ec6-476c-9bfc-f0470ced2fb9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:54 devstack sudo[141885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:13:54 devstack sudo[141885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:55 devstack sudo[141885]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.801s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:55 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:13:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:55 devstack sudo[141915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 Jun 23 14:13:55 devstack sudo[141915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:00 devstack sudo[141915]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" returned: 0 in 4.771s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:00 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[165bed0c-1255-4c83-ad7d-21548c0f1dd0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:00 devstack sudo[142069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:14:00 devstack sudo[142069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:01 devstack sudo[142069]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.957s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:01 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:14:01 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Converted 1024.00 MB image at 214.58 MB/s Jun 23 14:14:01 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 is being set with open permissions: ugo+rw Jun 23 14:14:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:01 devstack sudo[142104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 Jun 23 14:14:01 devstack sudo[142104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:01 devstack sudo[142104]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" returned: 0 in 0.721s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" released by "_copy_volume_from_snapshot" :: held 8.166s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Deleting offline snapshot 1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 of volume 5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] snapshot_file for this snap is: volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff771e-3bb5-4378-bf7e-2bf603d75af1]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:02 devstack sudo[142131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 Jun 23 14:14:02 devstack sudo[142131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=38,cinder:INSERT=16,cinder:UPDATE=65,cinder:DELETE=8 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:14:02 devstack sudo[142131]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" returned: 0 in 0.929s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:02 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:14:03 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf98a5d-6074-4a93-9c8b-77890606b9ba]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:03 devstack sudo[142170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:14:03 devstack sudo[142170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:03 devstack sudo[142170]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.812s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:03 devstack sudo[142199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 Jun 23 14:14:03 devstack sudo[142199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:04 devstack sudo[142199]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" returned: 0 in 0.845s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:04 devstack sudo[142232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52 Jun 23 14:14:04 devstack sudo[142232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:05 devstack sudo[142232]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8.1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" returned: 0 in 0.744s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-1ff97fe3-0f2d-4389-b08c-d64c5c6f6a52" released by "_delete_snapshot" :: held 3.477s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=50,cinder:SELECT=47,cinder:INSERT=11,cinder:DELETE=2 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.239s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58d3a0-a1e7-4223-94af-d7a0bd86d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97', 'volume_size': 1, 'source_volid': '5affd07f-4f60-4ed6-9d06-f2a807ad7fb8', 'source_volstatus': 'available'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06c3597-926a-421d-a8dd-a1d22ea6199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Volume volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 (8a3d53ce-7a3e-4687-83ca-069b07dd4f97): created successfully Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06c3597-926a-421d-a8dd-a1d22ea6199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (4de3328d-954e-4119-8a56-5385b3dd7f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:05 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-970d9ab6-aace-4b0e-8c4b-6be37bcd027c tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc2a5c2-7d42-44d2-922d-72c6d7e16623]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:05 devstack sudo[142274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 Jun 23 14:14:05 devstack sudo[142274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:06 devstack sudo[142274]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" returned: 0 in 0.813s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e', 'name': 'volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ba24dae-d44f-4f55-ae7c-766226d8174d', 'enforce_multipath': True} {{(pid=93689) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:14:06 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-b8f4152a-5ceb-43bf-8906-9e298a0f939a req-02fc9da5-b001-4e51-908a-74c8bfa4b5bb tempest-TestStampPattern-1281480901 None] attachment_update completed successfully. Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (a29e401b-e8db-4a0a-a25d-b832407649dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5dd2db-c971-49c3-b862-39c71406a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5dd2db-c971-49c3-b862-39c71406a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-616995352',display_name='tempest-VolumesGetTest-Volume-2031329210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427186df-73d9-4c73-8c43-77ad724cda22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:07Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86420eb7-c8d4-4fad-a649-6c1316890dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86420eb7-c8d4-4fad-a649-6c1316890dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72893b4c-e0dd-4e80-9a3b-f8548182ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72893b4c-e0dd-4e80-9a3b-f8548182ad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427186df-73d9-4c73-8c43-77ad724cda22', 'volume_name': 'volume-427186df-73d9-4c73-8c43-77ad724cda22', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c905188-a12d-448a-bd03-c0fda1c87bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c905188-a12d-448a-bd03-c0fda1c87bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19b048d-19af-4fdd-850c-66337440b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:07 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Volume 427186df-73d9-4c73-8c43-77ad724cda22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427186df-73d9-4c73-8c43-77ad724cda22', 'volume_size': 1} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-616995352',display_name='tempest-VolumesGetTest-Volume-2031329210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427186df-73d9-4c73-8c43-77ad724cda22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:07Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Creating volume 427186df-73d9-4c73-8c43-77ad724cda22 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:07 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:07 devstack sudo[142622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 1073741824 Jun 23 14:14:07 devstack sudo[142622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:08 devstack sudo[142622]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 1073741824" returned: 0 in 0.862s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:08 devstack sudo[142755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 Jun 23 14:14:08 devstack sudo[142755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:09 devstack sudo[142755]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22" returned: 0 in 0.649s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19b048d-19af-4fdd-850c-66337440b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427186df-73d9-4c73-8c43-77ad724cda22', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1e4439-2d86-4de8-81a1-8d5b053e8649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Volume volume-427186df-73d9-4c73-8c43-77ad724cda22 (427186df-73d9-4c73-8c43-77ad724cda22): created successfully Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1e4439-2d86-4de8-81a1-8d5b053e8649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (a29e401b-e8db-4a0a-a25d-b832407649dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1a3a5057-2a0c-4778-b0bb-f38b161a5194 tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-427186df-73d9-4c73-8c43-77ad724cda22-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Lock "cinder-427186df-73d9-4c73-8c43-77ad724cda22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-427186df-73d9-4c73-8c43-77ad724cda22" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-427186df-73d9-4c73-8c43-77ad724cda22" acquired by "delete_volume" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[57737ba2-8857-4ffe-b7ce-fbda50759fef]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:09 devstack sudo[142797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 Jun 23 14:14:09 devstack sudo[142797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:10 devstack sudo[142797]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22" returned: 0 in 0.764s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:10 devstack sudo[142826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22 Jun 23 14:14:10 devstack sudo[142826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:11 devstack sudo[142826]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-427186df-73d9-4c73-8c43-77ad724cda22" returned: 0 in 0.646s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-427186df-73d9-4c73-8c43-77ad724cda22" released by "delete_volume" :: held 1.447s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Created reservations ['1ec6df27-d7fd-497b-a3a1-99865440852a', '862cc24c-e500-4d7d-b4a9-6552e80e4813', 'c0d79d08-3019-47ee-b217-58526651001d', '3b50281f-aefa-4507-a497-eb66b61166a3'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:11 devstack sudo[142863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:11 devstack sudo[142863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-8a3d53ce-7a3e-4687-83ca-069b07dd4f97-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Lock "cinder-8a3d53ce-7a3e-4687-83ca-069b07dd4f97-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:11 devstack sudo[142863]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.742s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:11 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a90848b9-9b29-4b75-8dc5-8862e72e5e45 tempest-VolumesGetTest-1622103403 None] Lock "cinder-427186df-73d9-4c73-8c43-77ad724cda22-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[70829793-046c-4e36-9884-a4ed95056d0d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:12 devstack sudo[142896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 Jun 23 14:14:12 devstack sudo[142896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:12 devstack sudo[142896]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" returned: 0 in 0.729s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:12 devstack sudo[142922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97 Jun 23 14:14:12 devstack sudo[142922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [req-9335bb4c-bedb-47e8-87d2-303c5af92f02 req-66feeae0-51e5-4b55-b9c6-1d5d36a03f16 tempest-TestStampPattern-1281480901 None] Terminate volume connection completed successfully. Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [req-9335bb4c-bedb-47e8-87d2-303c5af92f02 req-66feeae0-51e5-4b55-b9c6-1d5d36a03f16 tempest-TestStampPattern-1281480901 None] Deleting attachment 3ba24dae-d44f-4f55-ae7c-766226d8174d. {{(pid=93689) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:14:13 devstack sudo[142922]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" returned: 0 in 0.735s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-8a3d53ce-7a3e-4687-83ca-069b07dd4f97" released by "delete_volume" :: held 1.500s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Created reservations ['7605cf38-6c12-4745-82e5-1b61868137d4', '0adadf71-06ec-4fa6-b6ef-b33f284fbfde', '2f5987b9-514c-453f-a4db-17689a593f03', '47ef9b3e-c59b-4b65-b78e-289e27b8c2b9'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:13 devstack sudo[142983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:13 devstack sudo[142983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Lock "cinder-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:14 devstack sudo[142983]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.721s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:14 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6453d58c-0a40-4be3-a902-28fdf8d81cff]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e0c568c3-65a0-436f-83d5-cc51f5aa2420 tempest-VolumesGetTest-1622103403 None] Lock "cinder-8a3d53ce-7a3e-4687-83ca-069b07dd4f97-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:14 devstack sudo[143007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:14:14 devstack sudo[143007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:15 devstack sudo[143007]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.770s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:15 devstack sudo[143037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8 Jun 23 14:14:15 devstack sudo[143037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:15 devstack sudo[143037]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" returned: 0 in 0.737s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8" released by "delete_volume" :: held 1.596s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Created reservations ['7264c4e4-6066-45fc-ad71-0d28b9eaee36', 'c39dd288-d757-45ca-b480-5da449a36138', '11eda98f-f836-4c96-ae4a-326df51e889d', '2793b07d-3584-431a-aaf4-73af74779b34'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:16 devstack sudo[143070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:16 devstack sudo[143070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:16 devstack sudo[143070]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.768s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:14:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-03c5401f-0302-44c2-b8ca-24d4bc85dd6b tempest-VolumesGetTest-1622103403 None] Lock "cinder-5affd07f-4f60-4ed6-9d06-f2a807ad7fb8-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (4f895b2a-1eea-43e6-930c-4b0326650daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb4ee28-17c2-4414-8a47-aefd6b433d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb4ee28-17c2-4414-8a47-aefd6b433d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-537234868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9478b4b0-e265-4e13-8674-1c13d0c16908,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:18Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4492b8a-fb43-44f5-be59-e4269d32a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4492b8a-fb43-44f5-be59-e4269d32a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e44019-22f7-4255-a2ff-6717cb49ad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:17 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e44019-22f7-4255-a2ff-6717cb49ad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9478b4b0-e265-4e13-8674-1c13d0c16908', 'volume_name': 'volume-9478b4b0-e265-4e13-8674-1c13d0c16908', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2633679-7ce7-4531-acdd-d4d6ecb76cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2633679-7ce7-4531-acdd-d4d6ecb76cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae4ea8c-6633-44f0-b06d-cbccbb5e75a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:18 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Volume 9478b4b0-e265-4e13-8674-1c13d0c16908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9478b4b0-e265-4e13-8674-1c13d0c16908', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Trying to clone 9478b4b0-e265-4e13-8674-1c13d0c16908 from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:14:18 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9258a37-65d4-405d-8625-bcf45cb5a7fa]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:18 devstack sudo[143186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD Jun 23 14:14:18 devstack sudo[143186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:19 devstack sudo[143186]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD" returned: 0 in 0.762s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:19 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed is fetched for user d0b4565e421d4f30b6c1695e4dde40a5. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:14:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f0a648-2de8-402b-a7c2-1d66268141f9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:19 devstack sudo[143218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD Jun 23 14:14:19 devstack sudo[143218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:20 devstack sudo[143218]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD" returned: 0 in 0.754s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-537234868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9478b4b0-e265-4e13-8674-1c13d0c16908,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:18Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Creating volume 9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:20 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:20 devstack sudo[143246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 1073741824 Jun 23 14:14:20 devstack sudo[143246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:21 devstack sudo[143246]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 1073741824" returned: 0 in 0.849s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:21 devstack sudo[143279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:21 devstack sudo[143279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:21 devstack sudo[143279]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 0 in 0.628s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Attempting download of 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume 9478b4b0-e265-4e13-8674-1c13d0c16908. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47adf11-0b6b-47f2-9448-9281063176c2]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:21 devstack sudo[143303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd Jun 23 14:14:21 devstack sudo[143303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:22 devstack sudo[143303]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd" returned: 0 in 0.761s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:22 devstack sudo[143331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd Jun 23 14:14:22 devstack sudo[143331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:23 devstack sudo[143331]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd" returned: 1 in 0.759s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ba7d2d6-fbde-443c-96de-e07fd76adfed_3_63adsd' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60a720-4f73-406c-b7eb-01ddac85a1b5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:23 devstack sudo[143356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD Jun 23 14:14:23 devstack sudo[143356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Lock "cinder-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-quobyte-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" acquired by "delete_volume" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad3414-68d3-4143-bf00-9507210c124b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:24 devstack sudo[143376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 Jun 23 14:14:24 devstack sudo[143376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:24 devstack sudo[143356]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD" returned: 0 in 0.789s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:24 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] 0ba7d2d6-fbde-443c-96de-e07fd76adfed was qcow2, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:14:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:24 devstack sudo[143387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:24 devstack sudo[143387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:24 devstack sudo[143376]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" returned: 0 in 0.813s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:24 devstack sudo[143413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13 Jun 23 14:14:24 devstack sudo[143413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:25 devstack sudo[143413]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" returned: 0 in 0.717s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13" released by "delete_volume" :: held 1.591s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Created reservations ['eea0866f-9c12-4041-b40c-705669eed390', '12336948-305e-41ab-b06d-23549a412660', '7f5d4f85-4429-4903-8bff-f45a7c790364', 'c9e949a6-3eb7-4d85-ba2d-4443319e6696'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:25 devstack sudo[143451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:25 devstack sudo[143451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:26 devstack sudo[143387]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 0 in 2.197s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ba7d2d6-fbde-443c-96de-e07fd76adfed_50twu0q7devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:14:26 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Converted 112.00 MB image at 50.94 MB/s Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:26 devstack sudo[143474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 1G Jun 23 14:14:26 devstack sudo[143474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-3e03a091-819d-4476-9000-5a6fac50017b-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:26 devstack sudo[143451]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.854s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Deleted volume successfully. Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Lock "cinder-3e03a091-819d-4476-9000-5a6fac50017b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-quobyte-e2c65887-6fba-4d2f-864e-d90734e561c9" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-e2c65887-6fba-4d2f-864e-d90734e561c9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-quobyte-3e03a091-819d-4476-9000-5a6fac50017b" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-278094c2-d01f-432d-bf50-53df2f1498f2 tempest-TestStampPattern-1281480901 None] Lock "cinder-42ae54b2-eee9-4f8a-b0ee-3dcb92f51e13-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-3e03a091-819d-4476-9000-5a6fac50017b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Deleting offline snapshot 3e03a091-819d-4476-9000-5a6fac50017b of volume e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] snapshot_file for this snap is: volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f14dcc4-4964-429b-8a13-c047a046d426]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:26 devstack sudo[143486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b Jun 23 14:14:26 devstack sudo[143486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:27 devstack sudo[143474]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 1G" returned: 0 in 0.795s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb543968-a06e-43d8-a018-eb5194e859ae]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:27 devstack sudo[143506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:27 devstack sudo[143506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:27 devstack sudo[143486]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b" returned: 0 in 0.843s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c65887-6fba-4d2f-864e-d90734e561c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7431f3-c7cd-4bdc-a5d8-810243930038]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:27 devstack sudo[143520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:14:27 devstack sudo[143520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:28 devstack sudo[143506]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 0 in 0.849s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:28 devstack sudo[143542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:28 devstack sudo[143542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:28 devstack sudo[143520]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 0.800s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:28 devstack sudo[143553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b Jun 23 14:14:28 devstack sudo[143553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:28 devstack sudo[143542]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 1 in 0.827s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Downloaded image 0ba7d2d6-fbde-443c-96de-e07fd76adfed ((None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}])) to volume 9478b4b0-e265-4e13-8674-1c13d0c16908 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Temporary image 0ba7d2d6-fbde-443c-96de-e07fd76adfed for user d0b4565e421d4f30b6c1695e4dde40a5 is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Marking volume 9478b4b0-e265-4e13-8674-1c13d0c16908 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Copying metadata from image 0ba7d2d6-fbde-443c-96de-e07fd76adfed to 9478b4b0-e265-4e13-8674-1c13d0c16908. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:14:28 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Creating volume glance metadata for volume 9478b4b0-e265-4e13-8674-1c13d0c16908 backed by image 0ba7d2d6-fbde-443c-96de-e07fd76adfed with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae4ea8c-6633-44f0-b06d-cbccbb5e75a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9478b4b0-e265-4e13-8674-1c13d0c16908', 'volume_size': 1, 'image_id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b667a4b3c34441e69b21a610b9874088', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ba7d2d6-fbde-443c-96de-e07fd76adfed', 'created_at': datetime.datetime(2026, 6, 23, 11, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 47, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ba7d2d6-fbde-443c-96de-e07fd76adfed/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19627da2-ec3e-43ae-9649-ce4d2b17576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:29 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Volume volume-9478b4b0-e265-4e13-8674-1c13d0c16908 (9478b4b0-e265-4e13-8674-1c13d0c16908): created successfully Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19627da2-ec3e-43ae-9649-ce4d2b17576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (4f895b2a-1eea-43e6-930c-4b0326650daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:29 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b99b5272-a161-4fb2-ae44-0401ba37ff68 tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:14:29 devstack sudo[143553]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b" returned: 0 in 0.856s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:29 devstack sudo[143588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b Jun 23 14:14:29 devstack sudo[143588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:29 devstack sudo[143588]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9.3e03a091-819d-4476-9000-5a6fac50017b" returned: 0 in 0.723s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-3e03a091-819d-4476-9000-5a6fac50017b" released by "_delete_snapshot" :: held 3.338s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-e2c65887-6fba-4d2f-864e-d90734e561c9" released by "delete_snapshot" :: held 3.376s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Created reservations ['e5615637-fa5d-4bb4-a198-86d116a6d4e0', '52e271aa-6e5a-436a-94e4-c9d4db9c6f8b', 'd8d71121-d034-46fe-9387-52630171046e', '9665fd87-a7c9-4950-a2b9-f0029578d36d'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:30 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Delete snapshot completed successfully. Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-693716fb-6163-40b5-a2f4-f1e3693086b3 tempest-TestStampPattern-1281480901 None] Lock "cinder-3e03a091-819d-4476-9000-5a6fac50017b-delete_snapshot" released by "delete_snapshot" :: held 3.617s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (2afdb8f2-0719-4e4a-815e-48c0178130ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73c4900-7e48-4c33-90c7-19fac510ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73c4900-7e48-4c33-90c7-19fac510ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181691078',display_name='tempest-VolumesGetTest-Volume-1790745927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb77317b-0aea-4d1c-8315-73a6bdd703a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:30Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09cca80-d6a7-4d95-8fce-69446cf7f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09cca80-d6a7-4d95-8fce-69446cf7f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2025177-a45f-467a-bda0-c747d35f7382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2025177-a45f-467a-bda0-c747d35f7382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb77317b-0aea-4d1c-8315-73a6bdd703a8', 'volume_name': 'volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82547c84-a12a-445a-b1d7-c27f7d71b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82547c84-a12a-445a-b1d7-c27f7d71b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8548496-b3bb-4400-936a-f5857f2809b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Volume fb77317b-0aea-4d1c-8315-73a6bdd703a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8', 'volume_size': 1} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181691078',display_name='tempest-VolumesGetTest-Volume-1790745927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb77317b-0aea-4d1c-8315-73a6bdd703a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59138240467b468082b516d72d17f229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:30Z,use_quota=True,user_id='d0b4565e421d4f30b6c1695e4dde40a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Creating volume fb77317b-0aea-4d1c-8315-73a6bdd703a8 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:30 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:30 devstack sudo[143627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 1073741824 Jun 23 14:14:30 devstack sudo[143627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:31 devstack sudo[143627]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 1073741824" returned: 0 in 1.010s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:31 devstack sudo[143666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 Jun 23 14:14:31 devstack sudo[143666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:32 devstack sudo[143666]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8" returned: 0 in 0.752s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8548496-b3bb-4400-936a-f5857f2809b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97cf9c0-47e5-4242-8060-1b8b43314146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Volume volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 (fb77317b-0aea-4d1c-8315-73a6bdd703a8): created successfully Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97cf9c0-47e5-4242-8060-1b8b43314146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Flow 'volume_create_manager' (2afdb8f2-0719-4e4a-815e-48c0178130ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-19c2f05b-2148-474d-a113-43bbee08ae26 tempest-VolumesGetTest-1622103403 None] Created volume successfully. Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:32 devstack sudo[143698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:32 devstack sudo[143698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-fb77317b-0aea-4d1c-8315-73a6bdd703a8-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Lock "cinder-fb77317b-0aea-4d1c-8315-73a6bdd703a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-fb77317b-0aea-4d1c-8315-73a6bdd703a8" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-fb77317b-0aea-4d1c-8315-73a6bdd703a8" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e4c7ce-7a3c-4875-9afc-8126e9526771]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:32 devstack sudo[143713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 Jun 23 14:14:32 devstack sudo[143713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:33 devstack sudo[143698]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.899s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:14:33 devstack sudo[143713]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8" returned: 0 in 1.068s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:33 devstack sudo[143790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8 Jun 23 14:14:33 devstack sudo[143790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:34 devstack sudo[143790]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-fb77317b-0aea-4d1c-8315-73a6bdd703a8" returned: 0 in 0.671s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-fb77317b-0aea-4d1c-8315-73a6bdd703a8" released by "delete_volume" :: held 1.789s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Created reservations ['1823d9ee-55c9-42f7-a4da-1c2a9c0b3520', '9475e07c-d2f1-4b1e-b1d3-7c52c78b611a', '2dd838c3-990d-4fc1-9baf-023e7638705f', '353c9c02-f19b-4c28-9cc0-d37d0fee1e97'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:34 devstack sudo[143820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:34 devstack sudo[143820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-9478b4b0-e265-4e13-8674-1c13d0c16908-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Lock "cinder-9478b4b0-e265-4e13-8674-1c13d0c16908-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Acquiring lock "cinder-quobyte-9478b4b0-e265-4e13-8674-1c13d0c16908" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-9478b4b0-e265-4e13-8674-1c13d0c16908" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4dd71-90a2-43af-916b-f66dc9891a59]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:35 devstack sudo[143847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:35 devstack sudo[143847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:35 devstack sudo[143820]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.875s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:35 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:14:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-10268f46-2fd5-4833-81a5-245c71a18d3a tempest-VolumesGetTest-1622103403 None] Lock "cinder-fb77317b-0aea-4d1c-8315-73a6bdd703a8-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:36 devstack sudo[143847]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 0 in 0.788s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:36 devstack sudo[143875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:36 devstack sudo[143875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:36 devstack sudo[143875]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 1 in 0.804s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:37 devstack sudo[143904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908 Jun 23 14:14:37 devstack sudo[143904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:37 devstack sudo[143904]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9478b4b0-e265-4e13-8674-1c13d0c16908" returned: 0 in 0.726s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Lock "cinder-quobyte-9478b4b0-e265-4e13-8674-1c13d0c16908" released by "delete_volume" :: held 2.409s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Created reservations ['cfa6899c-2f30-4e64-a559-76dce977677a', '0a5d2e83-e602-4131-b7a2-45fcae82bd15', 'e2b7dd71-5f3c-4a47-ac19-10003b976007', 'b3890706-37cf-4af8-98bb-f9f183204c4e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:37 devstack sudo[143932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:37 devstack sudo[143932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:38 devstack sudo[143932]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.701s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Deleted volume successfully. Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-7d4d67fe-208f-4ee7-af49-903ef83504b8 tempest-VolumesGetTest-1622103403 None] Lock "cinder-9478b4b0-e265-4e13-8674-1c13d0c16908-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-e2c65887-6fba-4d2f-864e-d90734e561c9-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Lock "cinder-e2c65887-6fba-4d2f-864e-d90734e561c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Acquiring lock "cinder-quobyte-e2c65887-6fba-4d2f-864e-d90734e561c9" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-e2c65887-6fba-4d2f-864e-d90734e561c9" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[776824b3-bf5f-4357-b2e9-0795954207bb]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:39 devstack sudo[143969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:14:39 devstack sudo[143969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:39 devstack sudo[143969]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 0.844s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:39 devstack sudo[143998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9 Jun 23 14:14:39 devstack sudo[143998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:40 devstack sudo[143998]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e2c65887-6fba-4d2f-864e-d90734e561c9" returned: 0 in 0.764s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Lock "cinder-quobyte-e2c65887-6fba-4d2f-864e-d90734e561c9" released by "delete_volume" :: held 1.678s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Created reservations ['6fb99727-f9bd-42e9-8258-40a520943228', 'ecaca943-f8c5-4204-b838-51aa0e059228', 'cab459ee-0ab6-4559-86b0-2cb32d7fcbca', '4c0bc76a-ab61-41ae-8e24-2190aef68942'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:40 devstack sudo[144028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:40 devstack sudo[144028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:41 devstack sudo[144028]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.732s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:41 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Deleted volume successfully. Jun 23 14:14:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ab2ab610-d850-42fd-85dc-5d273e6a8800 tempest-TestStampPattern-1281480901 None] Lock "cinder-e2c65887-6fba-4d2f-864e-d90734e561c9-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Flow 'volume_create_manager' (d2d5c746-2500-4a71-87db-54e428c8b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbf8626-1adf-4202-bf83-4c94508ee7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbf8626-1adf-4202-bf83-4c94508ee7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1594787563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7324f9c4bfec4cb8b61bf0039ae74776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:42Z,use_quota=True,user_id='e206140cb65c45ef9d165bf62c26a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bfce47-3b54-4e89-836f-83c685e3011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bfce47-3b54-4e89-836f-83c685e3011d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ac549c-5b67-45b2-9192-56d8f31790a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ac549c-5b67-45b2-9192-56d8f31790a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f', 'volume_name': 'volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbe6871-6fb9-4510-8ea8-a1bec9377c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbe6871-6fb9-4510-8ea8-a1bec9377c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d06f1e-9382-4e8e-ad78-9647b9163241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:42 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Volume 0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f', 'volume_size': 1} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1594787563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7324f9c4bfec4cb8b61bf0039ae74776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:42Z,use_quota=True,user_id='e206140cb65c45ef9d165bf62c26a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Creating volume 0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:42 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:42 devstack sudo[144079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f 1073741824 Jun 23 14:14:42 devstack sudo[144079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:43 devstack sudo[144079]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f 1073741824" returned: 0 in 0.955s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:43 devstack sudo[144115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f Jun 23 14:14:43 devstack sudo[144115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:43 devstack sudo[144115]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f" returned: 0 in 0.709s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d06f1e-9382-4e8e-ad78-9647b9163241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfcc3df-0b5e-44fa-9c3d-0171eec58206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:44 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Volume volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f (0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f): created successfully Jun 23 14:14:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfcc3df-0b5e-44fa-9c3d-0171eec58206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Flow 'volume_create_manager' (d2d5c746-2500-4a71-87db-54e428c8b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:44 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f90344a7-b13a-4f89-82c7-6fc063d55667 tempest-VolumesListTestJSON-1560794751 None] Created volume successfully. Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Flow 'volume_create_manager' (a30e3e17-d22e-4bf2-8a31-2f28b2d22307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6c88ba-2034-46d8-9393-48c693eaeaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6c88ba-2034-46d8-9393-48c693eaeaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-687622983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11db9a3a-0eb4-4d00-8de1-54f273889f90,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7324f9c4bfec4cb8b61bf0039ae74776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:45Z,use_quota=True,user_id='e206140cb65c45ef9d165bf62c26a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967e3a66-ade7-45cd-aeb5-814e0d0eba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967e3a66-ade7-45cd-aeb5-814e0d0eba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8247ccee-d62b-42b9-8857-3604aa64883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8247ccee-d62b-42b9-8857-3604aa64883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11db9a3a-0eb4-4d00-8de1-54f273889f90', 'volume_name': 'volume-11db9a3a-0eb4-4d00-8de1-54f273889f90', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ef04b9-ee9d-43e1-aa51-c4fd1b6f1bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ef04b9-ee9d-43e1-aa51-c4fd1b6f1bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299d6ddc-ea81-44cc-9713-9652d37e0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:45 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Volume 11db9a3a-0eb4-4d00-8de1-54f273889f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11db9a3a-0eb4-4d00-8de1-54f273889f90', 'volume_size': 1} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-687622983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11db9a3a-0eb4-4d00-8de1-54f273889f90,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7324f9c4bfec4cb8b61bf0039ae74776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:45Z,use_quota=True,user_id='e206140cb65c45ef9d165bf62c26a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Creating volume 11db9a3a-0eb4-4d00-8de1-54f273889f90 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:45 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:45 devstack sudo[144177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 1073741824 Jun 23 14:14:45 devstack sudo[144177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 1073741824" returned: 0 in 1.114s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:46 devstack sudo[144177]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:46 devstack sudo[144259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 Jun 23 14:14:46 devstack sudo[144259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:47 devstack sudo[144259]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90" returned: 0 in 0.727s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299d6ddc-ea81-44cc-9713-9652d37e0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11db9a3a-0eb4-4d00-8de1-54f273889f90', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6a3399-7e5f-433b-8106-2e10e72023ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:47 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Volume volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 (11db9a3a-0eb4-4d00-8de1-54f273889f90): created successfully Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6a3399-7e5f-433b-8106-2e10e72023ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:47 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Flow 'volume_create_manager' (a30e3e17-d22e-4bf2-8a31-2f28b2d22307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1c9647ab-d255-4618-b01c-dec3cd69441a tempest-VolumesListTestJSON-1560794751 None] Created volume successfully. Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Flow 'volume_create_manager' (84634eb5-3f74-4383-bd3d-e3a1b676894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6036259d-73d7-4fb0-a317-4377935a8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6036259d-73d7-4fb0-a317-4377935a8756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-747668179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b18d52-dbd5-499c-a53e-846a939f7702,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7324f9c4bfec4cb8b61bf0039ae74776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:49Z,use_quota=True,user_id='e206140cb65c45ef9d165bf62c26a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a080d241-6431-47be-84f7-445cb845babc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a080d241-6431-47be-84f7-445cb845babc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a09a924-067d-454b-b4d2-09354c0ba881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a09a924-067d-454b-b4d2-09354c0ba881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b18d52-dbd5-499c-a53e-846a939f7702', 'volume_name': 'volume-63b18d52-dbd5-499c-a53e-846a939f7702', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ab5ce7-bdfe-4968-94bc-db05774e90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ab5ce7-bdfe-4968-94bc-db05774e90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c7660-da00-41d8-b520-27fe91d2f65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:48 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Volume 63b18d52-dbd5-499c-a53e-846a939f7702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b18d52-dbd5-499c-a53e-846a939f7702', 'volume_size': 1} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-747668179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b18d52-dbd5-499c-a53e-846a939f7702,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7324f9c4bfec4cb8b61bf0039ae74776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:49Z,use_quota=True,user_id='e206140cb65c45ef9d165bf62c26a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Creating volume 63b18d52-dbd5-499c-a53e-846a939f7702 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:48 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:48 devstack sudo[144338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 1073741824 Jun 23 14:14:48 devstack sudo[144338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:50 devstack sudo[144338]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 1073741824" returned: 0 in 1.119s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:50 devstack sudo[144377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 Jun 23 14:14:50 devstack sudo[144377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:50 devstack sudo[144377]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702" returned: 0 in 0.765s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214c7660-da00-41d8-b520-27fe91d2f65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b18d52-dbd5-499c-a53e-846a939f7702', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e095b5c4-3e28-45b7-b995-50555a0eccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:50 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Volume volume-63b18d52-dbd5-499c-a53e-846a939f7702 (63b18d52-dbd5-499c-a53e-846a939f7702): created successfully Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e095b5c4-3e28-45b7-b995-50555a0eccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:50 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Flow 'volume_create_manager' (84634eb5-3f74-4383-bd3d-e3a1b676894e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-bb92ef76-4c45-4355-9ab1-43d3558def8e tempest-VolumesListTestJSON-1560794751 None] Created volume successfully. Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "cinder-63b18d52-dbd5-499c-a53e-846a939f7702-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-63b18d52-dbd5-499c-a53e-846a939f7702-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "cinder-quobyte-63b18d52-dbd5-499c-a53e-846a939f7702" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-quobyte-63b18d52-dbd5-499c-a53e-846a939f7702" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4eeea9-5d51-49d3-9f66-7a3e05e7d9a6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:54 devstack sudo[144513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 Jun 23 14:14:54 devstack sudo[144513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Flow 'volume_create_manager' (cbdee835-0a0a-4793-a99b-50dfe65abdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7b8da5-7c51-4306-b136-5961e3d11162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7b8da5-7c51-4306-b136-5961e3d11162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1401908619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0874885b-014f-4d58-8f93-f167e99438ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20eb5fde9c2448539c68f2cd7c904adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:55Z,use_quota=True,user_id='c6d33c42d41a432fbc913cdca2588fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29a95be-d8b1-4cae-93c2-b1b094a28733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29a95be-d8b1-4cae-93c2-b1b094a28733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1d5606-19f8-4374-a22b-06c49676edda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1d5606-19f8-4374-a22b-06c49676edda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0874885b-014f-4d58-8f93-f167e99438ef', 'volume_name': 'volume-0874885b-014f-4d58-8f93-f167e99438ef', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ec5b08-0654-43b9-a1d3-578e96943bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ec5b08-0654-43b9-a1d3-578e96943bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55eb884-ad93-480e-b3e5-ffc2d9bc5d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:54 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Volume 0874885b-014f-4d58-8f93-f167e99438ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0874885b-014f-4d58-8f93-f167e99438ef', 'volume_size': 1} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1401908619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0874885b-014f-4d58-8f93-f167e99438ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20eb5fde9c2448539c68f2cd7c904adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:55Z,use_quota=True,user_id='c6d33c42d41a432fbc913cdca2588fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Creating volume 0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:54 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:14:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:54 devstack sudo[144521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef 1073741824 Jun 23 14:14:54 devstack sudo[144521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:55 devstack sudo[144513]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702" returned: 0 in 0.955s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:55 devstack sudo[144551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702 Jun 23 14:14:55 devstack sudo[144551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:55 devstack sudo[144521]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef 1073741824" returned: 0 in 1.045s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:55 devstack sudo[144567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:14:55 devstack sudo[144567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:56 devstack sudo[144551]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-63b18d52-dbd5-499c-a53e-846a939f7702" returned: 0 in 0.715s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-quobyte-63b18d52-dbd5-499c-a53e-846a939f7702" released by "delete_volume" :: held 1.737s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Created reservations ['a5148bd9-8ac3-44b3-9774-7c9edc8f9bbc', 'a9dd8d83-9ac1-4a20-af53-a5e4ffcccb7e', '1414140f-03db-40d4-bd3a-d1ad3faa5840', 'a1ace253-e50d-4a5f-bd48-a0463067a57a'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:56 devstack sudo[144586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:56 devstack sudo[144586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:56 devstack sudo[144567]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.855s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "cinder-11db9a3a-0eb4-4d00-8de1-54f273889f90-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55eb884-ad93-480e-b3e5-ffc2d9bc5d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0874885b-014f-4d58-8f93-f167e99438ef', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aefa6d5-2891-458f-95c6-2d7c22a5826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-11db9a3a-0eb4-4d00-8de1-54f273889f90-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:56 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Volume volume-0874885b-014f-4d58-8f93-f167e99438ef (0874885b-014f-4d58-8f93-f167e99438ef): created successfully Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aefa6d5-2891-458f-95c6-2d7c22a5826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Flow 'volume_create_manager' (cbdee835-0a0a-4793-a99b-50dfe65abdfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d771528c-cd4e-4f10-a6db-3d5598a1cab5 tempest-VolumeDependencyTests-904360712 None] Created volume successfully. Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "cinder-quobyte-11db9a3a-0eb4-4d00-8de1-54f273889f90" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-quobyte-11db9a3a-0eb4-4d00-8de1-54f273889f90" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[864fbbef-b063-4a51-9ae8-f7b713394e57]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:56 devstack sudo[144604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 Jun 23 14:14:56 devstack sudo[144604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:56 devstack sudo[144586]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.665s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:56 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:56 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Deleted volume successfully. Jun 23 14:14:57 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d5fc5fa6-0ae7-4c06-91ae-b15e6f2ad68e tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-63b18d52-dbd5-499c-a53e-846a939f7702-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:57 devstack sudo[144604]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90" returned: 0 in 0.791s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:57 devstack sudo[144634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90 Jun 23 14:14:57 devstack sudo[144634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Creating offline snapshot 357e384f-ca3b-4571-af89-b4697a7ec132 of volume 0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0c0838-e478-4b76-a8d6-21037068330a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:58 devstack sudo[144651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:14:58 devstack sudo[144651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:58 devstack sudo[144634]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-11db9a3a-0eb4-4d00-8de1-54f273889f90" returned: 0 in 0.772s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-quobyte-11db9a3a-0eb4-4d00-8de1-54f273889f90" released by "delete_volume" :: held 1.609s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Created reservations ['9c84d393-b7a1-4587-a329-aa6d399b7ab1', '20e87941-594e-4c51-8e4d-fc5e2f567f3e', '155076c5-3f57-4fac-9cd5-75fdfeec2bd3', '9e3512bd-1fdd-43b8-97cf-27d0a31dbaef'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:58 devstack sudo[144668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:14:58 devstack sudo[144668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:58 devstack sudo[144651]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:58 devstack sudo[144683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 1G Jun 23 14:14:58 devstack sudo[144683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "cinder-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "cinder-quobyte-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-quobyte-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e439cce-3adb-4c46-8a36-cbb11a9d7889]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:59 devstack sudo[144694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f Jun 23 14:14:59 devstack sudo[144694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:59 devstack sudo[144668]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.818s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:59 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Deleted volume successfully. Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b2d98b5e-7e9d-485f-bb64-0e397e08ae3c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-11db9a3a-0eb4-4d00-8de1-54f273889f90-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:59 devstack sudo[144683]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 1G" returned: 0 in 1.007s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0874885b-014f-4d58-8f93-f167e99438ef -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:59 devstack sudo[144723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0874885b-014f-4d58-8f93-f167e99438ef -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 Jun 23 14:14:59 devstack sudo[144723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:00 devstack sudo[144694]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f" returned: 0 in 0.888s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:00 devstack sudo[144733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f Jun 23 14:15:00 devstack sudo[144733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:00 devstack sudo[144723]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0874885b-014f-4d58-8f93-f167e99438ef -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132" returned: 0 in 0.747s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:00 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 is being set with open permissions: ugo+rw Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:00 devstack sudo[144757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 Jun 23 14:15:00 devstack sudo[144757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:00 devstack sudo[144733]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f" returned: 0 in 0.738s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-quobyte-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f" released by "delete_volume" :: held 1.696s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:00 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Created reservations ['713def3c-294c-41e1-9c44-bf1c456515a7', '85ae54ef-4f74-4fdf-9194-18cc8fe55a41', 'bcea99b2-5480-4613-b719-0452520b4974', '22743a1a-052b-4f85-88d9-36ee0e43cf3f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:01 devstack sudo[144772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:01 devstack sudo[144772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:01 devstack sudo[144757]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132" returned: 0 in 0.743s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:01 devstack sudo[144789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info Jun 23 14:15:01 devstack sudo[144789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:01 devstack sudo[144772]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.776s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:01 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Deleted volume successfully. Jun 23 14:15:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9579a725-8e2d-482b-836e-9ca402264d7c tempest-VolumesListTestJSON-1560794751 None] Lock "cinder-0d3588ae-d6a0-4a1d-9b43-4b43f3d8945f-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:02 devstack sudo[144789]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info" returned: 0 in 0.757s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:02 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info is being set with open permissions: ugo+rw Jun 23 14:15:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:02 devstack sudo[144815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info Jun 23 14:15:02 devstack sudo[144815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:03 devstack sudo[144815]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.info" returned: 0 in 0.859s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.090s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:03 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=124,cinder:SELECT=83,cinder:INSERT=31,cinder:DELETE=5 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:15:03 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-49d05e56-6536-4e91-a16d-9a85aadcadb4 tempest-VolumeDependencyTests-904360712 None] Create snapshot completed successfully Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Flow 'volume_create_manager' (609a18ee-715a-40b4-b03c-ea0c7b536fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1440e806-0037-41e9-8b8a-10792e18fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1440e806-0037-41e9-8b8a-10792e18fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1211654387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1be14c5-801b-40f8-861c-9948b1ade6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20eb5fde9c2448539c68f2cd7c904adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=357e384f-ca3b-4571-af89-b4697a7ec132,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:04Z,use_quota=True,user_id='c6d33c42d41a432fbc913cdca2588fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73eb508-8337-4eb9-9fe7-1de215836232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73eb508-8337-4eb9-9fe7-1de215836232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c9b5f-c23b-47a2-b216-cc5194623f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c9b5f-c23b-47a2-b216-cc5194623f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1be14c5-801b-40f8-861c-9948b1ade6f6', 'volume_name': 'volume-c1be14c5-801b-40f8-861c-9948b1ade6f6', 'volume_size': 1, 'snapshot_id': '357e384f-ca3b-4571-af89-b4697a7ec132'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef14190-e17d-4169-bb48-f088bc980a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef14190-e17d-4169-bb48-f088bc980a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fbc7fc-f305-437c-9bc2-8b5d0d819762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Volume c1be14c5-801b-40f8-861c-9948b1ade6f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1be14c5-801b-40f8-861c-9948b1ade6f6', 'volume_size': 1, 'snapshot_id': '357e384f-ca3b-4571-af89-b4697a7ec132'} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-quobyte-357e384f-ca3b-4571-af89-b4697a7ec132-c1be14c5-801b-40f8-861c-9948b1ade6f6" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-357e384f-ca3b-4571-af89-b4697a7ec132-c1be14c5-801b-40f8-861c-9948b1ade6f6" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Creating volume c1be14c5-801b-40f8-861c-9948b1ade6f6 from snapshot 357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-quobyte-c1be14c5-801b-40f8-861c-9948b1ade6f6" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-c1be14c5-801b-40f8-861c-9948b1ade6f6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] snapshot: 357e384f-ca3b-4571-af89-b4697a7ec132, volume: c1be14c5-801b-40f8-861c-9948b1ade6f6, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0342fca-4552-460b-a1c7-684d5de63a9b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:04 devstack sudo[144881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 Jun 23 14:15:04 devstack sudo[144881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:05 devstack sudo[144881]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132" returned: 0 in 0.865s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0874885b-014f-4d58-8f93-f167e99438ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:15:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:15:05 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:15:05 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06a4993-22c5-40cc-904a-217b5191d6c4]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:05 devstack sudo[144914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:15:05 devstack sudo[144914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:06 devstack sudo[144914]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.820s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:06 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:15:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:06 devstack sudo[144943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 Jun 23 14:15:06 devstack sudo[144943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=105,cinder:DELETE=14,cinder:SELECT=97,cinder:INSERT=35 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Flow 'volume_create_manager' (ecfc2fbf-931b-4d37-a032-c86a904b8934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9347cb31-2d2d-4dd1-8f63-41c8db4af077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9347cb31-2d2d-4dd1-8f63-41c8db4af077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c53244-976f-4612-b101-e49b7cd258b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663fa16230354dc69c9e6ba0e5f293e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:11Z,use_quota=True,user_id='3e30eff4b4d144a2b3a0797e2c5029c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ac0cfe-7bc5-44e7-98f8-62906162e290),volume_type_id=a8ac0cfe-7bc5-44e7-98f8-62906162e290)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e62ef0-e64b-420c-a523-158e27e903b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e62ef0-e64b-420c-a523-158e27e903b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3457e177-bfd0-41e5-b578-ca950408afca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:15:11 devstack sudo[144943]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6" returned: 0 in 5.517s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b5a78c-3054-4aa0-92c5-e1f896e21467]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3457e177-bfd0-41e5-b578-ca950408afca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68c53244-976f-4612-b101-e49b7cd258b5', 'volume_name': 'volume-68c53244-976f-4612-b101-e49b7cd258b5', 'volume_size': 1, 'image_id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ccb19c3-9219-4f5b-b44f-39194d838270', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44aac9ab9f22f5e1aef38ffdbbcf46be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '663fa16230354dc69c9e6ba0e5f293e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ab6a688cb123e637e066567510d083c966d2596dd14aaac2cd62d17466d1d8d2dea747171c8ff8ff2138f45fb2f187c73eaaa20248ed7ef47e1742e3ac5f06f', 'id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'created_at': datetime.datetime(2026, 6, 23, 12, 15, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 15, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ccb19c3-9219-4f5b-b44f-39194d838270/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9571e8-f360-473b-bd65-6384a6b4c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9571e8-f360-473b-bd65-6384a6b4c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dd166b-34da-40e1-8bbb-f7a3f27c5e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Volume 68c53244-976f-4612-b101-e49b7cd258b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68c53244-976f-4612-b101-e49b7cd258b5', 'volume_size': 1, 'image_id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ccb19c3-9219-4f5b-b44f-39194d838270', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44aac9ab9f22f5e1aef38ffdbbcf46be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '663fa16230354dc69c9e6ba0e5f293e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ab6a688cb123e637e066567510d083c966d2596dd14aaac2cd62d17466d1d8d2dea747171c8ff8ff2138f45fb2f187c73eaaa20248ed7ef47e1742e3ac5f06f', 'id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'created_at': datetime.datetime(2026, 6, 23, 12, 15, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 15, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ccb19c3-9219-4f5b-b44f-39194d838270/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Trying to clone 68c53244-976f-4612-b101-e49b7cd258b5 from image 2ccb19c3-9219-4f5b-b44f-39194d838270 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ccb19c3-9219-4f5b-b44f-39194d838270', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:15:11 devstack sudo[145127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:15:11 devstack sudo[145127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:15:11 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a4d734-a08c-49ba-82de-bf803073b1c8]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:11 devstack sudo[145135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD Jun 23 14:15:11 devstack sudo[145135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:12 devstack sudo[145135]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:12 devstack sudo[145127]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.971s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:12 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:15:12 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Converted 1024.00 MB image at 185.56 MB/s Jun 23 14:15:12 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 is being set with open permissions: ugo+rw Jun 23 14:15:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:12 devstack sudo[145166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 Jun 23 14:15:12 devstack sudo[145166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:12 devstack sudo[145163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD Jun 23 14:15:12 devstack sudo[145163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:13 devstack sudo[145166]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6" returned: 0 in 0.626s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-c1be14c5-801b-40f8-861c-9948b1ade6f6" released by "_copy_volume_from_snapshot" :: held 8.910s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-357e384f-ca3b-4571-af89-b4697a7ec132-c1be14c5-801b-40f8-861c-9948b1ade6f6" released by "_create_volume_from_snapshot" :: held 8.940s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.957s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fbc7fc-f305-437c-9bc2-8b5d0d819762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1be14c5-801b-40f8-861c-9948b1ade6f6', 'volume_size': 1, 'snapshot_id': '357e384f-ca3b-4571-af89-b4697a7ec132'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacea04e-87d2-4eb6-bdf5-b42d85af95df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Volume volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 (c1be14c5-801b-40f8-861c-9948b1ade6f6): created successfully Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacea04e-87d2-4eb6-bdf5-b42d85af95df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Flow 'volume_create_manager' (609a18ee-715a-40b4-b03c-ea0c7b536fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:13 devstack sudo[145163]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-3b19edaf-4b9b-4e6d-bea9-6166c5dd3177 tempest-VolumeDependencyTests-904360712 None] Created volume successfully. Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD" returned: 1 in 0.750s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Temporary image 2ccb19c3-9219-4f5b-b44f-39194d838270 is fetched for user 3e30eff4b4d144a2b3a0797e2c5029c0. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[467abb3e-53c5-49a5-8019-847ddbd3a697]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:13 devstack sudo[145197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD Jun 23 14:15:13 devstack sudo[145197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-357e384f-ca3b-4571-af89-b4697a7ec132-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-357e384f-ca3b-4571-af89-b4697a7ec132-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-quobyte-0874885b-014f-4d58-8f93-f167e99438ef" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-0874885b-014f-4d58-8f93-f167e99438ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-quobyte-357e384f-ca3b-4571-af89-b4697a7ec132" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-357e384f-ca3b-4571-af89-b4697a7ec132" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Deleting offline snapshot 357e384f-ca3b-4571-af89-b4697a7ec132 of volume 0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] snapshot_file for this snap is: volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cf21d7-36d0-4097-8859-b5ef0fee1f3f]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:14 devstack sudo[145197]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:14 devstack sudo[145223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 Jun 23 14:15:14 devstack sudo[145223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:14 devstack sudo[145224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD Jun 23 14:15:14 devstack sudo[145224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:14 devstack sudo[145224]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD" returned: 1 in 0.732s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c53244-976f-4612-b101-e49b7cd258b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='663fa16230354dc69c9e6ba0e5f293e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:11Z,use_quota=True,user_id='3e30eff4b4d144a2b3a0797e2c5029c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8ac0cfe-7bc5-44e7-98f8-62906162e290),volume_type_id=a8ac0cfe-7bc5-44e7-98f8-62906162e290)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Creating volume 68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:14 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:15:14 devstack sudo[145223]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132" returned: 0 in 0.781s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0874885b-014f-4d58-8f93-f167e99438ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:15:14 devstack sudo[145257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 1073741824 Jun 23 14:15:14 devstack sudo[145257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d45198-c2c2-4ec6-8696-dbcfcbb45876]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:15 devstack sudo[145259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:15:15 devstack sudo[145259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:15 devstack sudo[145259]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.824s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:15 devstack sudo[145293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 Jun 23 14:15:15 devstack sudo[145293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:15 devstack sudo[145257]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 1073741824" returned: 0 in 0.905s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:15 devstack sudo[145298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:15 devstack sudo[145298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:16 devstack sudo[145298]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 0 in 0.688s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Attempting download of 2ccb19c3-9219-4f5b-b44f-39194d838270 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ccb19c3-9219-4f5b-b44f-39194d838270', 'metadata': {}}])) to volume 68c53244-976f-4612-b101-e49b7cd258b5. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:15:16 devstack sudo[145293]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132" returned: 0 in 0.843s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff9fa1-d62d-4c75-9af0-064c0242e792]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_ {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:16 devstack sudo[145328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132 Jun 23 14:15:16 devstack sudo[145328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:16 devstack sudo[145329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_ Jun 23 14:15:16 devstack sudo[145329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:17 devstack sudo[145328]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef.357e384f-ca3b-4571-af89-b4697a7ec132" returned: 0 in 0.714s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-357e384f-ca3b-4571-af89-b4697a7ec132" released by "_delete_snapshot" :: held 3.276s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-0874885b-014f-4d58-8f93-f167e99438ef" released by "delete_snapshot" :: held 3.307s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Created reservations ['a556e5ea-4cf6-4d3c-a633-6c0efa4a1b07', '67674219-63ce-4960-8dfe-a4c8f6d98e1b', 'd438bf05-4bd1-42a7-a04d-e97c8cc8e487', '7a6f3353-7da1-40eb-ad3e-8ae530de5d0e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:17 devstack sudo[145329]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_" returned: 0 in 0.825s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_ {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Delete snapshot completed successfully. Jun 23 14:15:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-11222f98-3916-4f72-9fc6-2d594ef7910f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-357e384f-ca3b-4571-af89-b4697a7ec132-delete_snapshot" released by "delete_snapshot" :: held 3.484s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:17 devstack sudo[145361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_ Jun 23 14:15:17 devstack sudo[145361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:18 devstack sudo[145361]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_" returned: 1 in 0.723s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ccb19c3-9219-4f5b-b44f-39194d838270_pxlf1vj_' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dfdc72-b391-42a0-9f17-5050d781b67d]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-0874885b-014f-4d58-8f93-f167e99438ef-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:18 devstack sudo[145386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD Jun 23 14:15:18 devstack sudo[145386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Lock "cinder-0874885b-014f-4d58-8f93-f167e99438ef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-quobyte-0874885b-014f-4d58-8f93-f167e99438ef" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-0874885b-014f-4d58-8f93-f167e99438ef" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c848e538-bc1f-420b-a45c-834c9ce94f21]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:18 devstack sudo[145397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:15:18 devstack sudo[145397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:18 devstack sudo[145386]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:19 devstack sudo[145416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD Jun 23 14:15:19 devstack sudo[145416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:19 devstack sudo[145397]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.821s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:19 devstack sudo[145430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef Jun 23 14:15:19 devstack sudo[145430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:19 devstack sudo[145416]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] 2ccb19c3-9219-4f5b-b44f-39194d838270 was raw, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:19 devstack sudo[145447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:19 devstack sudo[145447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:19 devstack sudo[145430]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0874885b-014f-4d58-8f93-f167e99438ef" returned: 0 in 0.692s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-0874885b-014f-4d58-8f93-f167e99438ef" released by "delete_volume" :: held 1.575s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Created reservations ['31c0b80b-c06e-42aa-8ff5-7c216d76a04c', '303c5f1d-c13f-4cd4-b75a-f04ad06943c8', '8719e17a-bfc3-4f32-8e56-e7038f3310fa', '3c828999-1b00-4388-81d5-6ec19382ba12'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:20 devstack sudo[145462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:20 devstack sudo[145462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:20 devstack sudo[145447]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 0 in 0.729s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ccb19c3-9219-4f5b-b44f-39194d838270__0ggtiwkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:15:20 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:20 devstack sudo[145479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 1G Jun 23 14:15:20 devstack sudo[145479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-c1be14c5-801b-40f8-861c-9948b1ade6f6-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-c1be14c5-801b-40f8-861c-9948b1ade6f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Acquiring lock "cinder-quobyte-c1be14c5-801b-40f8-861c-9948b1ade6f6" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-c1be14c5-801b-40f8-861c-9948b1ade6f6" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab61a4-babf-4676-950c-86947c70e74e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:20 devstack sudo[145487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 Jun 23 14:15:20 devstack sudo[145487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:20 devstack sudo[145462]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.740s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Deleted volume successfully. Jun 23 14:15:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b4006089-0e50-4dec-9fe5-352f6b91335b tempest-VolumeDependencyTests-904360712 None] Lock "cinder-0874885b-014f-4d58-8f93-f167e99438ef-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:21 devstack sudo[145479]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 1G" returned: 0 in 0.776s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[49550086-0130-4510-b79e-47180fcbdaa9]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:21 devstack sudo[145511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:21 devstack sudo[145511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:21 devstack sudo[145487]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6" returned: 0 in 0.829s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:21 devstack sudo[145522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6 Jun 23 14:15:21 devstack sudo[145522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:22 devstack sudo[145511]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 0 in 0.829s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:22 devstack sudo[145544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:22 devstack sudo[145544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:22 devstack sudo[145522]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-c1be14c5-801b-40f8-861c-9948b1ade6f6" returned: 0 in 0.752s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-quobyte-c1be14c5-801b-40f8-861c-9948b1ade6f6" released by "delete_volume" :: held 1.641s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Created reservations ['6a10410d-3a50-4497-a9df-a283c684c6bb', 'b5a059d1-b98d-4062-8581-3a5ff3b8a1cd', '6781714f-dd7f-43ab-88a5-fca57c8d7193', 'f2480915-725a-4894-9591-496ce86a7603'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:22 devstack sudo[145556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:22 devstack sudo[145556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:22 devstack sudo[145544]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 1 in 0.850s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Downloaded image 2ccb19c3-9219-4f5b-b44f-39194d838270 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ccb19c3-9219-4f5b-b44f-39194d838270', 'metadata': {}}])) to volume 68c53244-976f-4612-b101-e49b7cd258b5 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Temporary image 2ccb19c3-9219-4f5b-b44f-39194d838270 for user 3e30eff4b4d144a2b3a0797e2c5029c0 is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Marking volume 68c53244-976f-4612-b101-e49b7cd258b5 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Copying metadata from image 2ccb19c3-9219-4f5b-b44f-39194d838270 to 68c53244-976f-4612-b101-e49b7cd258b5. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:15:22 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Creating volume glance metadata for volume 68c53244-976f-4612-b101-e49b7cd258b5 backed by image 2ccb19c3-9219-4f5b-b44f-39194d838270 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44aac9ab9f22f5e1aef38ffdbbcf46be', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dd166b-34da-40e1-8bbb-f7a3f27c5e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c53244-976f-4612-b101-e49b7cd258b5', 'volume_size': 1, 'image_id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ccb19c3-9219-4f5b-b44f-39194d838270', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44aac9ab9f22f5e1aef38ffdbbcf46be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '663fa16230354dc69c9e6ba0e5f293e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ab6a688cb123e637e066567510d083c966d2596dd14aaac2cd62d17466d1d8d2dea747171c8ff8ff2138f45fb2f187c73eaaa20248ed7ef47e1742e3ac5f06f', 'id': '2ccb19c3-9219-4f5b-b44f-39194d838270', 'created_at': datetime.datetime(2026, 6, 23, 12, 15, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 15, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ccb19c3-9219-4f5b-b44f-39194d838270/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6bb02e-aa3a-4ed8-ac04-a573a60d8a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Volume volume-68c53244-976f-4612-b101-e49b7cd258b5 (68c53244-976f-4612-b101-e49b7cd258b5): created successfully Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6bb02e-aa3a-4ed8-ac04-a573a60d8a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Flow 'volume_create_manager' (ecfc2fbf-931b-4d37-a032-c86a904b8934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e82657fe-8f38-4d29-b3ac-75f6e765d2ed tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Created volume successfully. Jun 23 14:15:23 devstack sudo[145556]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.750s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Deleted volume successfully. Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a9dd2665-d284-4883-9129-17245af27f4f tempest-VolumeDependencyTests-904360712 None] Lock "cinder-c1be14c5-801b-40f8-861c-9948b1ade6f6-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Acquiring lock "cinder-68c53244-976f-4612-b101-e49b7cd258b5-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "cinder-68c53244-976f-4612-b101-e49b7cd258b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Acquiring lock "cinder-quobyte-68c53244-976f-4612-b101-e49b7cd258b5" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "cinder-quobyte-68c53244-976f-4612-b101-e49b7cd258b5" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b3ab1f-381d-4fd5-9f86-0078fe3d09f3]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:24 devstack sudo[145611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:24 devstack sudo[145611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:24 devstack sudo[145611]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 0 in 0.883s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:25 devstack sudo[145642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:25 devstack sudo[145642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:25 devstack sudo[145642]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 1 in 0.811s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:15:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:25 devstack sudo[145672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5 Jun 23 14:15:25 devstack sudo[145672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:26 devstack sudo[145672]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-68c53244-976f-4612-b101-e49b7cd258b5" returned: 0 in 0.713s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "cinder-quobyte-68c53244-976f-4612-b101-e49b7cd258b5" released by "delete_volume" :: held 2.479s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:26 devstack cinder-volume[93689]: WARNING cinder.quota [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:15:26 devstack cinder-volume[93689]: WARNING cinder.quota [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Created reservations ['a8ab24ae-1108-4798-9f24-379de8a987a8', 'a2d1953f-fb22-4e7e-b4e6-7edda6a74a24', 'feee3ca3-bda6-4326-bcf0-dc249fd9b702', '07075bdf-1c45-4a20-9879-8bd030a248ca'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:26 devstack sudo[145699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:26 devstack sudo[145699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:27 devstack sudo[145699]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.726s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:27 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:27 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Deleted volume successfully. Jun 23 14:15:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-0841ae84-42ef-45e8-8bb6-de18e3c41c5f tempest-VolumeAndVolumeTypeFromImageTest-1389884497 None] Lock "cinder-68c53244-976f-4612-b101-e49b7cd258b5-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Flow 'volume_create_manager' (52d2619c-ef0b-4277-9e14-a7935955df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cf6ad2-2ba4-419e-b804-e88acc5d1f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cf6ad2-2ba4-419e-b804-e88acc5d1f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b1020f-afb7-43fa-8830-52408c761a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01f39f2da3b47058060dfe85b7551f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:32Z,use_quota=True,user_id='b864102fbbdb44bb94f6419fb0d1f77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abcb46-9d1e-4914-9b54-812329871d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60abcb46-9d1e-4914-9b54-812329871d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b10485-dfb9-422e-b28c-6350999ecaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b10485-dfb9-422e-b28c-6350999ecaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b1020f-afb7-43fa-8830-52408c761a62', 'volume_name': 'volume-96b1020f-afb7-43fa-8830-52408c761a62', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5675c816-85ba-436d-8e73-8db4b50d3efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5675c816-85ba-436d-8e73-8db4b50d3efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62a179e-ebb7-4a2c-bff9-acbd7e613f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Volume 96b1020f-afb7-43fa-8830-52408c761a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b1020f-afb7-43fa-8830-52408c761a62', 'volume_size': 1} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b1020f-afb7-43fa-8830-52408c761a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01f39f2da3b47058060dfe85b7551f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:32Z,use_quota=True,user_id='b864102fbbdb44bb94f6419fb0d1f77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Creating volume 96b1020f-afb7-43fa-8830-52408c761a62 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:31 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:15:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:31 devstack sudo[145861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 1073741824 Jun 23 14:15:31 devstack sudo[145861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:32 devstack sudo[145878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:32 devstack sudo[145878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:32 devstack sudo[145861]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 1073741824" returned: 0 in 0.873s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:32 devstack sudo[145896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 Jun 23 14:15:32 devstack sudo[145896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:33 devstack sudo[145878]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.724s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:15:33 devstack sudo[145896]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62" returned: 0 in 0.695s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62a179e-ebb7-4a2c-bff9-acbd7e613f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b1020f-afb7-43fa-8830-52408c761a62', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f6f47-0e02-4a6b-ab75-6e4683571ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:33 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Volume volume-96b1020f-afb7-43fa-8830-52408c761a62 (96b1020f-afb7-43fa-8830-52408c761a62): created successfully Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654f6f47-0e02-4a6b-ab75-6e4683571ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Flow 'volume_create_manager' (52d2619c-ef0b-4277-9e14-a7935955df8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d6b3ac46-74b7-46ae-a681-3f0813cb784b tempest-CinderUnicodeTest-1114482043 None] Created volume successfully. Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Flow 'volume_create_manager' (9aed81fb-9785-49a3-b661-8842f40e7ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfde90-583d-4699-b37e-ea98e0142a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfde90-583d-4699-b37e-ea98e0142a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1079287165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e877ad7-8551-4ea9-97ed-56d5217debd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01f39f2da3b47058060dfe85b7551f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:34Z,use_quota=True,user_id='b864102fbbdb44bb94f6419fb0d1f77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c462f04-a6e8-4ade-b722-cd571e85700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c462f04-a6e8-4ade-b722-cd571e85700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defadb18-9cce-4cc8-981c-6b4ba04b456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defadb18-9cce-4cc8-981c-6b4ba04b456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e877ad7-8551-4ea9-97ed-56d5217debd8', 'volume_name': 'volume-4e877ad7-8551-4ea9-97ed-56d5217debd8', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3cc2ef-ba71-4b48-a776-2d8c93eb532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3cc2ef-ba71-4b48-a776-2d8c93eb532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678bfcc1-4c4f-4b03-b99d-2c2ea05d21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Volume 4e877ad7-8551-4ea9-97ed-56d5217debd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e877ad7-8551-4ea9-97ed-56d5217debd8', 'volume_size': 1} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1079287165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e877ad7-8551-4ea9-97ed-56d5217debd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01f39f2da3b47058060dfe85b7551f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:34Z,use_quota=True,user_id='b864102fbbdb44bb94f6419fb0d1f77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Creating volume 4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:34 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:15:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:34 devstack sudo[145954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 1073741824 Jun 23 14:15:34 devstack sudo[145954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:35 devstack sudo[145954]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 1073741824" returned: 0 in 0.848s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:35 devstack sudo[145990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 Jun 23 14:15:35 devstack sudo[145990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:36 devstack sudo[145990]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8" returned: 0 in 0.634s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678bfcc1-4c4f-4b03-b99d-2c2ea05d21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e877ad7-8551-4ea9-97ed-56d5217debd8', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca8d3d0-23fa-47a0-a287-6958f52654d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Volume volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 (4e877ad7-8551-4ea9-97ed-56d5217debd8): created successfully Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca8d3d0-23fa-47a0-a287-6958f52654d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Flow 'volume_create_manager' (9aed81fb-9785-49a3-b661-8842f40e7ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-898b687a-af4c-4e02-8919-c55d3cbfdd81 tempest-CinderUnicodeTest-1114482043 None] Created volume successfully. Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Creating offline snapshot 0324dc22-294b-4f3c-99d4-674bbf0ce413 of volume 4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2745cea-5878-4a3c-ba03-f859d1162093]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:37 devstack sudo[146035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 Jun 23 14:15:37 devstack sudo[146035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:37 devstack sudo[146035]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8" returned: 0 in 0.807s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:37 devstack sudo[146064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 1G Jun 23 14:15:37 devstack sudo[146064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:38 devstack sudo[146064]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 1G" returned: 0 in 0.774s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:38 devstack sudo[146092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 Jun 23 14:15:38 devstack sudo[146092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:39 devstack sudo[146092]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413" returned: 0 in 0.669s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:39 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 is being set with open permissions: ugo+rw Jun 23 14:15:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:39 devstack sudo[146116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 Jun 23 14:15:39 devstack sudo[146116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:39 devstack sudo[146116]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413" returned: 0 in 0.622s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:39 devstack sudo[146140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info Jun 23 14:15:39 devstack sudo[146140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:40 devstack sudo[146140]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info" returned: 0 in 0.707s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:40 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info is being set with open permissions: ugo+rw Jun 23 14:15:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:40 devstack sudo[146164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info Jun 23 14:15:40 devstack sudo[146164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:41 devstack sudo[146164]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.info" returned: 0 in 0.641s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.313s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-be5dff46-6dd2-4de9-8e0f-ae5b1453fdb7 tempest-CinderUnicodeTest-1114482043 None] Create snapshot completed successfully Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-0324dc22-294b-4f3c-99d4-674bbf0ce413-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-0324dc22-294b-4f3c-99d4-674bbf0ce413-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-quobyte-4e877ad7-8551-4ea9-97ed-56d5217debd8" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-4e877ad7-8551-4ea9-97ed-56d5217debd8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-quobyte-0324dc22-294b-4f3c-99d4-674bbf0ce413" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-0324dc22-294b-4f3c-99d4-674bbf0ce413" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Deleting offline snapshot 0324dc22-294b-4f3c-99d4-674bbf0ce413 of volume 4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] snapshot_file for this snap is: volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b853e3f-a9ef-4ec6-a0fc-04abbafccf50]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:42 devstack sudo[146215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 Jun 23 14:15:42 devstack sudo[146215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:42 devstack sudo[146215]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413" returned: 0 in 0.811s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:42 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e877ad7-8551-4ea9-97ed-56d5217debd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:15:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96140f5-70e4-4e4a-9a6b-3061757edc2a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:43 devstack sudo[146248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 Jun 23 14:15:43 devstack sudo[146248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:43 devstack sudo[146248]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8" returned: 0 in 0.755s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:43 devstack sudo[146274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 Jun 23 14:15:43 devstack sudo[146274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:44 devstack sudo[146274]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413" returned: 0 in 0.768s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:44 devstack sudo[146305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413 Jun 23 14:15:44 devstack sudo[146305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:45 devstack sudo[146305]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8.0324dc22-294b-4f3c-99d4-674bbf0ce413" returned: 0 in 0.668s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-0324dc22-294b-4f3c-99d4-674bbf0ce413" released by "_delete_snapshot" :: held 3.113s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-4e877ad7-8551-4ea9-97ed-56d5217debd8" released by "delete_snapshot" :: held 3.134s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:45 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Created reservations ['267f0237-51a6-4dc3-8396-e467bbf18cdb', '668fec6b-42d6-4f39-8611-80e80bdfb32d', 'ffddf623-cb97-4728-98d8-9855690b064a', '211d137f-8d62-4f55-b471-9224c8f515c0'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Delete snapshot completed successfully. Jun 23 14:15:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ec413e9a-80fd-4ed2-b92f-f88e5fef43ca tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-0324dc22-294b-4f3c-99d4-674bbf0ce413-delete_snapshot" released by "delete_snapshot" :: held 3.282s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-4e877ad7-8551-4ea9-97ed-56d5217debd8-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-4e877ad7-8551-4ea9-97ed-56d5217debd8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-quobyte-4e877ad7-8551-4ea9-97ed-56d5217debd8" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-4e877ad7-8551-4ea9-97ed-56d5217debd8" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:46 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5ecc5c-d04e-4f77-9e8e-fcb027b9b355]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:46 devstack sudo[146402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 Jun 23 14:15:46 devstack sudo[146402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:47 devstack sudo[146402]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8" returned: 0 in 0.805s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:47 devstack sudo[146433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8 Jun 23 14:15:47 devstack sudo[146433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:47 devstack sudo[146433]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-4e877ad7-8551-4ea9-97ed-56d5217debd8" returned: 0 in 0.703s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-4e877ad7-8551-4ea9-97ed-56d5217debd8" released by "delete_volume" :: held 1.571s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Created reservations ['9bca014e-4072-49cb-bd67-e271b288716d', 'c771b278-9086-4136-9a9e-8c86730444fe', 'd5a7a860-d42c-4731-a555-49e9f922c66b', 'd2edf39a-71d8-4fc6-ac98-45f3bad73f88'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:48 devstack sudo[146463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:48 devstack sudo[146463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-96b1020f-afb7-43fa-8830-52408c761a62-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-96b1020f-afb7-43fa-8830-52408c761a62-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "cinder-quobyte-96b1020f-afb7-43fa-8830-52408c761a62" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-96b1020f-afb7-43fa-8830-52408c761a62" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16cb09f-8d99-4929-8e16-0065fff4d12d]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:48 devstack sudo[146463]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.701s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:48 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Deleted volume successfully. Jun 23 14:15:48 devstack sudo[146484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 Jun 23 14:15:48 devstack sudo[146484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9b7858ce-7636-42ad-beec-e053a963a0c4 tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-4e877ad7-8551-4ea9-97ed-56d5217debd8-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:49 devstack sudo[146484]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62" returned: 0 in 0.781s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:49 devstack sudo[146513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62 Jun 23 14:15:49 devstack sudo[146513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:50 devstack sudo[146513]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-96b1020f-afb7-43fa-8830-52408c761a62" returned: 0 in 0.663s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-quobyte-96b1020f-afb7-43fa-8830-52408c761a62" released by "delete_volume" :: held 1.490s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Created reservations ['29347ead-de82-461c-b12a-8ba4e9a63ef0', '6ed5bb24-14dd-40b6-8078-a515eb49f4f6', '69e552d0-5af6-4ee4-b270-03009564bfe3', 'b8cc7214-6518-4500-9b18-3bd8c5621376'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:50 devstack sudo[146540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:15:50 devstack sudo[146540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:51 devstack sudo[146540]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.666s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:51 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Deleted volume successfully. Jun 23 14:15:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-e2c88538-d0ec-48bd-b311-f2f1e523bc6d tempest-CinderUnicodeTest-1114482043 None] Lock "cinder-96b1020f-afb7-43fa-8830-52408c761a62-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:00 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=64,cinder:SELECT=49,cinder:INSERT=18,cinder:DELETE=5 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:16:01 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:DELETE=5,cinder:INSERT=24 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (fb3db27c-f07b-4ead-afc1-c9f8eba11089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ad5ebd-faca-4bd9-8d88-7df7fb4dfd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ad5ebd-faca-4bd9-8d88-7df7fb4dfd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737678218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9861d20f-5c07-4df5-a1bf-41c3a25bad28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:04Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfd97bf-81f4-4d67-aa92-e1f28b1a358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfd97bf-81f4-4d67-aa92-e1f28b1a358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f899071a-be77-4c54-a49c-152c3990e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f899071a-be77-4c54-a49c-152c3990e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9861d20f-5c07-4df5-a1bf-41c3a25bad28', 'volume_name': 'volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7848822e-b76f-4645-aa81-891ba3ad160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7848822e-b76f-4645-aa81-891ba3ad160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13291d8f-7703-4909-b60f-3ec09ffcfe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Volume 9861d20f-5c07-4df5-a1bf-41c3a25bad28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28', 'volume_size': 1} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737678218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9861d20f-5c07-4df5-a1bf-41c3a25bad28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:04Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Creating volume 9861d20f-5c07-4df5-a1bf-41c3a25bad28 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:04 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:04 devstack sudo[147004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 1073741824 Jun 23 14:16:04 devstack sudo[147004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (97faeaa1-24b2-4091-aa4c-c1b87233b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cf5d7a-e5cc-49eb-92b9-832f13121756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cf5d7a-e5cc-49eb-92b9-832f13121756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470360964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca867f2f-ae90-4923-b065-de6a4634f076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:04Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f9bd44-15c4-4449-8dfa-d9b1ddd4bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f9bd44-15c4-4449-8dfa-d9b1ddd4bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d59e2-ad77-45e7-8dbd-ab76d1cd8d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d59e2-ad77-45e7-8dbd-ab76d1cd8d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca867f2f-ae90-4923-b065-de6a4634f076', 'volume_name': 'volume-ca867f2f-ae90-4923-b065-de6a4634f076', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bca496-a265-4f6b-80f7-b58cd7742922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bca496-a265-4f6b-80f7-b58cd7742922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3123b5d7-e2f2-419b-9a76-23892efc338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume ca867f2f-ae90-4923-b065-de6a4634f076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca867f2f-ae90-4923-b065-de6a4634f076', 'volume_size': 1} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (4338cfc6-267f-4003-80c2-24f259239fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6d1747-6f3e-41f0-a07c-b89e1f532448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6d1747-6f3e-41f0-a07c-b89e1f532448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433467922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced30330-9263-485c-ad2e-d01dc8a647df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:05Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3eb962d-1e4f-4c61-8697-aaadf8f98ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3eb962d-1e4f-4c61-8697-aaadf8f98ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d32aa7c-b287-4f77-9f6b-519cef2fb89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d32aa7c-b287-4f77-9f6b-519cef2fb89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced30330-9263-485c-ad2e-d01dc8a647df', 'volume_name': 'volume-ced30330-9263-485c-ad2e-d01dc8a647df', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:04 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3543593-f050-4ce0-adb5-77dd8ff68111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3543593-f050-4ce0-adb5-77dd8ff68111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b925433-287e-442d-bdc4-9a44ddda17fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Volume ced30330-9263-485c-ad2e-d01dc8a647df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced30330-9263-485c-ad2e-d01dc8a647df', 'volume_size': 1} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (865ae137-7b06-470f-bc0e-261e604019b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f6f648-47d1-4c3b-8725-8589fbaadbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f6f648-47d1-4c3b-8725-8589fbaadbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1132454285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850265f3-9d03-4c2e-8cd4-86da0fa4cc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:05Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065f5dc8-3e21-433e-87c0-20f72bb1933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065f5dc8-3e21-433e-87c0-20f72bb1933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fe5249-f682-4fc4-b380-5c71e32c6e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fe5249-f682-4fc4-b380-5c71e32c6e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850265f3-9d03-4c2e-8cd4-86da0fa4cc50', 'volume_name': 'volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b875efc-fbb2-447d-954d-2fefa0d22752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b875efc-fbb2-447d-954d-2fefa0d22752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8966195-f794-435b-904a-7140df80ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume 850265f3-9d03-4c2e-8cd4-86da0fa4cc50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50', 'volume_size': 1} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (8928eea5-65c1-4621-8310-794105fba18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0048ea32-10bc-40a5-b03c-0d270a601d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0048ea32-10bc-40a5-b03c-0d270a601d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004576017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a195749-61d6-4a07-9199-a1c3801c5844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:05Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815af828-42b9-4c9b-a6d3-ba82d96980f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815af828-42b9-4c9b-a6d3-ba82d96980f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cf49fc-0e9b-48a9-8744-e067c15a87f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cf49fc-0e9b-48a9-8744-e067c15a87f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a195749-61d6-4a07-9199-a1c3801c5844', 'volume_name': 'volume-3a195749-61d6-4a07-9199-a1c3801c5844', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc25693-9ff4-4f0a-b7de-e8f197cd15d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc25693-9ff4-4f0a-b7de-e8f197cd15d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deefabf1-6449-4eda-a894-67f7433db714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Volume 3a195749-61d6-4a07-9199-a1c3801c5844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a195749-61d6-4a07-9199-a1c3801c5844', 'volume_size': 1} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (2e7ac588-d137-43f5-b885-14febea03a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b72ec3d-95b7-4dd6-9cc7-9bc8b284a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b72ec3d-95b7-4dd6-9cc7-9bc8b284a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1085947932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0579c902-718f-460e-ab05-418d2567fce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:06Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3794215-78b0-4d6b-992b-ae07ab59868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3794215-78b0-4d6b-992b-ae07ab59868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc128c2-2d2f-4cce-866a-07c6ce9f668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc128c2-2d2f-4cce-866a-07c6ce9f668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0579c902-718f-460e-ab05-418d2567fce9', 'volume_name': 'volume-0579c902-718f-460e-ab05-418d2567fce9', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840e56ab-d9bc-4bd3-8959-a9f7042dd011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840e56ab-d9bc-4bd3-8959-a9f7042dd011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01b9c29-321d-4e74-a019-0a410ccf08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:05 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Volume 0579c902-718f-460e-ab05-418d2567fce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0579c902-718f-460e-ab05-418d2567fce9', 'volume_size': 1} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:05 devstack sudo[147004]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 1073741824" returned: 0 in 1.414s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:05 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:05 devstack sudo[147056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 Jun 23 14:16:05 devstack sudo[147056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (42685bc7-c7a3-4ecd-827e-cf6b36cbd2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8091ab0b-54b2-4cad-80fb-48deb645e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8091ab0b-54b2-4cad-80fb-48deb645e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797864643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb355d2-fdf1-418f-8d68-7d6d622e444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:06Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4307b9ea-60c5-41a3-bc77-610c0713a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4307b9ea-60c5-41a3-bc77-610c0713a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50c34c3-5723-4404-9e05-f42e7e641a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50c34c3-5723-4404-9e05-f42e7e641a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb355d2-fdf1-418f-8d68-7d6d622e444e', 'volume_name': 'volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1c1dbd-330d-4b14-a007-037dd5879e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1c1dbd-330d-4b14-a007-037dd5879e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7e9000-19d5-474c-8983-c9dc1629b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Volume 3fb355d2-fdf1-418f-8d68-7d6d622e444e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e', 'volume_size': 1} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:06 devstack sudo[147056]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28" returned: 0 in 0.718s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470360964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca867f2f-ae90-4923-b065-de6a4634f076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:04Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating volume ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:06 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13291d8f-7703-4909-b60f-3ec09ffcfe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:06 devstack sudo[147086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 1073741824 Jun 23 14:16:06 devstack sudo[147086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f88bf8c-d4f2-40b6-a7a0-aab81f778637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Volume volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 (9861d20f-5c07-4df5-a1bf-41c3a25bad28): created successfully Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f88bf8c-d4f2-40b6-a7a0-aab81f778637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (fb3db27c-f07b-4ead-afc1-c9f8eba11089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:06 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ea34cbdd-ea4d-4eb6-b962-e4bd020372e4 tempest-CreateVolumesFromImageTest-156601761 None] Created volume successfully. Jun 23 14:16:07 devstack sudo[147086]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 1073741824" returned: 0 in 0.881s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:07 devstack sudo[147119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 Jun 23 14:16:07 devstack sudo[147119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:08 devstack sudo[147119]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076" returned: 0 in 0.662s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.256s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433467922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced30330-9263-485c-ad2e-d01dc8a647df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:05Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Creating volume ced30330-9263-485c-ad2e-d01dc8a647df {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:08 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3123b5d7-e2f2-419b-9a76-23892efc338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca867f2f-ae90-4923-b065-de6a4634f076', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack sudo[147143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df 1073741824 Jun 23 14:16:08 devstack sudo[147143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5885ba83-bcc1-410e-9f4d-9a920d12c982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume volume-ca867f2f-ae90-4923-b065-de6a4634f076 (ca867f2f-ae90-4923-b065-de6a4634f076): created successfully Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5885ba83-bcc1-410e-9f4d-9a920d12c982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (97faeaa1-24b2-4091-aa4c-c1b87233b601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:08 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-16959c19-5056-4b27-be67-ba138aa02807 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created volume successfully. Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Flow 'volume_create_manager' (8718bd82-68a6-4f8c-8129-e00803af25fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3dcc46-f522-40b3-9fd7-0d88abafceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3dcc46-f522-40b3-9fd7-0d88abafceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c5213d-4ebb-4498-900f-a969daa85706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0fa3431b314c1c8efc52e42b071065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:09Z,use_quota=True,user_id='f7bf9ed128ae4d4597742fe86075e4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(248a6da0-f977-4c0a-993c-2952f127c5e6),volume_type_id=248a6da0-f977-4c0a-993c-2952f127c5e6)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72eea68-167a-4467-8a2d-c13041bf6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72eea68-167a-4467-8a2d-c13041bf6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f556d05d-b267-4c0b-b69d-3e97f1b5e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:16:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f556d05d-b267-4c0b-b69d-3e97f1b5e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23c5213d-4ebb-4498-900f-a969daa85706', 'volume_name': 'volume-23c5213d-4ebb-4498-900f-a969daa85706', 'volume_size': 1, 'image_id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6662522-7ad7-4f22-93d6-03f283059c95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5823a2899983471f7ecf2f65b0ca0344', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e0fa3431b314c1c8efc52e42b071065', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '866732c028f1c3fdd02bd8beb138d33b522471a0440442ec5da0c9d9acaab23890ddcde04c2b82ca23395ddf070e8ae3390c090c47c71ced2917f82ca990f7f3', 'id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'created_at': datetime.datetime(2026, 6, 23, 12, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6662522-7ad7-4f22-93d6-03f283059c95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc948db8-5376-4e69-b73a-cc772cc14349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc948db8-5376-4e69-b73a-cc772cc14349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396a6e87-3fb8-4c20-8529-26261c57be21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:09 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Volume 23c5213d-4ebb-4498-900f-a969daa85706: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23c5213d-4ebb-4498-900f-a969daa85706', 'volume_size': 1, 'image_id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6662522-7ad7-4f22-93d6-03f283059c95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5823a2899983471f7ecf2f65b0ca0344', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e0fa3431b314c1c8efc52e42b071065', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '866732c028f1c3fdd02bd8beb138d33b522471a0440442ec5da0c9d9acaab23890ddcde04c2b82ca23395ddf070e8ae3390c090c47c71ced2917f82ca990f7f3', 'id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'created_at': datetime.datetime(2026, 6, 23, 12, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6662522-7ad7-4f22-93d6-03f283059c95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Trying to clone 23c5213d-4ebb-4498-900f-a969daa85706 from image d6662522-7ad7-4f22-93d6-03f283059c95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6662522-7ad7-4f22-93d6-03f283059c95', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:16:09 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4624f0e-567a-44b8-85a8-c6c45c6e57ee]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:09 devstack sudo[147143]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df 1073741824" returned: 0 in 0.998s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:09 devstack sudo[147180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df Jun 23 14:16:09 devstack sudo[147180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:09 devstack sudo[147176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD Jun 23 14:16:09 devstack sudo[147176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:10 devstack sudo[147180]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:10 devstack sudo[147176]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df" returned: 0 in 0.712s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.838s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1132454285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850265f3-9d03-4c2e-8cd4-86da0fa4cc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:05Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Creating volume 850265f3-9d03-4c2e-8cd4-86da0fa4cc50 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:10 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:10 devstack sudo[147207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 1073741824 Jun 23 14:16:10 devstack sudo[147207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b925433-287e-442d-bdc4-9a44ddda17fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced30330-9263-485c-ad2e-d01dc8a647df', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad227a3-ea41-41ba-ab5c-8d3f1cedb692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:10 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Volume volume-ced30330-9263-485c-ad2e-d01dc8a647df (ced30330-9263-485c-ad2e-d01dc8a647df): created successfully Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad227a3-ea41-41ba-ab5c-8d3f1cedb692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (4338cfc6-267f-4003-80c2-24f259239fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:10 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-df7e4a03-71d1-41a0-b7eb-dfc617fb6543 tempest-CreateVolumesFromImageTest-156601761 None] Created volume successfully. Jun 23 14:16:10 devstack sudo[147208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD Jun 23 14:16:10 devstack sudo[147208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:10 devstack sudo[147208]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD" returned: 1 in 0.831s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Temporary image d6662522-7ad7-4f22-93d6-03f283059c95 is fetched for user f7bf9ed128ae4d4597742fe86075e4bd. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c5e3f9-0ba8-4ead-927e-0a6eefbf2ef3]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:11 devstack sudo[147207]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 1073741824" returned: 0 in 0.969s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:11 devstack sudo[147249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 Jun 23 14:16:11 devstack sudo[147249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:11 devstack sudo[147245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD Jun 23 14:16:11 devstack sudo[147245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:11 devstack sudo[147249]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50" returned: 0 in 0.751s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:11 devstack sudo[147245]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.394s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004576017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a195749-61d6-4a07-9199-a1c3801c5844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:05Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Creating volume 3a195749-61d6-4a07-9199-a1c3801c5844 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:11 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:11 devstack sudo[147279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 1073741824 Jun 23 14:16:11 devstack sudo[147279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8966195-f794-435b-904a-7140df80ea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2a81b3-3b9f-4413-bfbe-77b30b86ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 (850265f3-9d03-4c2e-8cd4-86da0fa4cc50): created successfully Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2a81b3-3b9f-4413-bfbe-77b30b86ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (865ae137-7b06-470f-bc0e-261e604019b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9160955c-dfcc-44e9-80e0-997c9bbad520 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created volume successfully. Jun 23 14:16:11 devstack sudo[147280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD Jun 23 14:16:11 devstack sudo[147280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:12 devstack sudo[147280]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD" returned: 1 in 1.068s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:12 devstack sudo[147279]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 1073741824" returned: 0 in 1.179s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (463ecd83-abd3-45e2-af5b-13614732b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faf280a-8e3c-48da-8571-7df428c87059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faf280a-8e3c-48da-8571-7df428c87059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183469224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a22b3d-58fd-46ef-bccf-0012b668dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:13Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f72444e-d87d-4fc4-8af5-83ff3f180607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f72444e-d87d-4fc4-8af5-83ff3f180607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab361d88-2835-4737-b3cf-9fe4d99818bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab361d88-2835-4737-b3cf-9fe4d99818bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a22b3d-58fd-46ef-bccf-0012b668dfed', 'volume_name': 'volume-75a22b3d-58fd-46ef-bccf-0012b668dfed', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209fa691-2b6b-4754-a369-909aa8880956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209fa691-2b6b-4754-a369-909aa8880956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e463b1f-c8c3-4b2a-85a4-d592dcca0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume 75a22b3d-58fd-46ef-bccf-0012b668dfed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a22b3d-58fd-46ef-bccf-0012b668dfed', 'volume_size': 1} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:13 devstack sudo[147330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 Jun 23 14:16:13 devstack sudo[147330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (29f8dfbe-0b77-42a6-9e19-f5c4ac9234c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da375f55-563f-4108-a9c5-5b2898d976c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da375f55-563f-4108-a9c5-5b2898d976c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279067825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bfbda3-b5f4-49b4-9313-b3a049d9814e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:13Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548505ec-22be-40e5-a49c-b0bdf9de3ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548505ec-22be-40e5-a49c-b0bdf9de3ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc061e0-617f-4f63-85b6-b1d9cd690996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc061e0-617f-4f63-85b6-b1d9cd690996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bfbda3-b5f4-49b4-9313-b3a049d9814e', 'volume_name': 'volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06671d7-e98e-4e0b-835a-b72ff8ba197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06671d7-e98e-4e0b-835a-b72ff8ba197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d0a62e-a894-4de8-964a-e437522b8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume 78bfbda3-b5f4-49b4-9313-b3a049d9814e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e', 'volume_size': 1} Jun 23 14:16:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (bd86a6cc-40e3-41b8-a23b-e2114e2b3b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:14 devstack sudo[147330]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a129d9ad-814d-4bc0-95ee-936c7f46e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844" returned: 0 in 0.898s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.349s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1085947932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0579c902-718f-460e-ab05-418d2567fce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:06Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Creating volume 0579c902-718f-460e-ab05-418d2567fce9 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:14 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a129d9ad-814d-4bc0-95ee-936c7f46e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011795635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:14Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1990db10-8cd9-44f9-8ec5-a648bb5158ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack sudo[147361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 1073741824 Jun 23 14:16:14 devstack sudo[147361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1990db10-8cd9-44f9-8ec5-a648bb5158ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5bad24-3f31-4d8a-b096-6a2e10e6cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5bad24-3f31-4d8a-b096-6a2e10e6cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12', 'volume_name': 'volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd3eefb-4446-4ed5-97ba-ec8e694c3143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd3eefb-4446-4ed5-97ba-ec8e694c3143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1026701-7a4a-4f7d-b37c-c4f1a944d979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12', 'volume_size': 1} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deefabf1-6449-4eda-a894-67f7433db714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a195749-61d6-4a07-9199-a1c3801c5844', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732be5d5-7d76-4e5f-b704-90a3ccb89ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Volume volume-3a195749-61d6-4a07-9199-a1c3801c5844 (3a195749-61d6-4a07-9199-a1c3801c5844): created successfully Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732be5d5-7d76-4e5f-b704-90a3ccb89ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (8928eea5-65c1-4621-8310-794105fba18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:14 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a741f574-36c3-4314-aff7-75b1ea2e4cd6 tempest-CreateVolumesFromImageTest-156601761 None] Created volume successfully. Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (17a06a21-2977-4363-89c4-4b7499b644ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668f2e01-9c8d-4740-bf60-0e3f41b8389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668f2e01-9c8d-4740-bf60-0e3f41b8389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235381609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cba193-960c-4d58-afdf-f35786bd344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:15Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c0d943-9053-461d-978a-7ea8e2c55c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c0d943-9053-461d-978a-7ea8e2c55c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5320865e-954e-4d3f-b586-c6074d374f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5320865e-954e-4d3f-b586-c6074d374f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9cba193-960c-4d58-afdf-f35786bd344d', 'volume_name': 'volume-f9cba193-960c-4d58-afdf-f35786bd344d', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d8c59-aea9-4e83-809c-07c8ac3df560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d8c59-aea9-4e83-809c-07c8ac3df560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b95741-eeeb-49b9-9c5f-afaddf5b7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:14 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume f9cba193-960c-4d58-afdf-f35786bd344d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9cba193-960c-4d58-afdf-f35786bd344d', 'volume_size': 1} Jun 23 14:16:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (8df56cd4-195a-4261-8504-64c3cd1af182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429fc8df-b013-4b35-8de0-7cdd71759a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429fc8df-b013-4b35-8de0-7cdd71759a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129953926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84a1b2e-928c-40b0-8a53-241b559ab411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:15Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40701320-de1e-4db6-b52a-2b85615794ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40701320-de1e-4db6-b52a-2b85615794ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c18b1eb-01e7-4c48-8782-f40cf2f0f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c18b1eb-01e7-4c48-8782-f40cf2f0f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84a1b2e-928c-40b0-8a53-241b559ab411', 'volume_name': 'volume-e84a1b2e-928c-40b0-8a53-241b559ab411', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef9e1e1-9465-41ee-a00b-302c5a4aad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef9e1e1-9465-41ee-a00b-302c5a4aad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2da7ac-d76b-4323-88e0-d73bf9f46414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:15 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume e84a1b2e-928c-40b0-8a53-241b559ab411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84a1b2e-928c-40b0-8a53-241b559ab411', 'volume_size': 1} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:15 devstack sudo[147361]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 1073741824" returned: 0 in 0.991s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:15 devstack sudo[147398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 Jun 23 14:16:15 devstack sudo[147398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:15 devstack sudo[147398]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9" returned: 0 in 0.633s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.587s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797864643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb355d2-fdf1-418f-8d68-7d6d622e444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e31f6715f4491d89a98654e728f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:06Z,use_quota=True,user_id='5767b04e817a4f97989b4d078056bcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Creating volume 3fb355d2-fdf1-418f-8d68-7d6d622e444e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:15 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:15 devstack sudo[147420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e 1073741824 Jun 23 14:16:15 devstack sudo[147420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b01b9c29-321d-4e74-a019-0a410ccf08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0579c902-718f-460e-ab05-418d2567fce9', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3701968e-fd6e-4e7a-9f48-5fef4605cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:15 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Volume volume-0579c902-718f-460e-ab05-418d2567fce9 (0579c902-718f-460e-ab05-418d2567fce9): created successfully Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3701968e-fd6e-4e7a-9f48-5fef4605cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:15 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (2e7ac588-d137-43f5-b885-14febea03a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-0d75375e-1a2d-4429-a203-b5f8f7f6ea91 tempest-CreateVolumesFromImageTest-156601761 None] Created volume successfully. Jun 23 14:16:16 devstack sudo[147420]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e 1073741824" returned: 0 in 0.860s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:16 devstack sudo[147452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e Jun 23 14:16:16 devstack sudo[147452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:17 devstack sudo[147452]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e" returned: 0 in 0.678s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.472s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating offline snapshot 275cf056-5d13-44be-a8eb-515eccf13492 of volume ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7e9000-19d5-474c-8983-c9dc1629b729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bf83cc-4827-4100-966a-c56975c0f7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[692fb5a5-739a-4558-8086-e65a199823fd]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:17 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Volume volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e (3fb355d2-fdf1-418f-8d68-7d6d622e444e): created successfully Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bf83cc-4827-4100-966a-c56975c0f7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:17 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Flow 'volume_create_manager' (42685bc7-c7a3-4ecd-827e-cf6b36cbd2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:17 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-324c7f03-8023-49b4-a2b2-650a460688c1 tempest-CreateVolumesFromImageTest-156601761 None] Created volume successfully. Jun 23 14:16:17 devstack sudo[147476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 Jun 23 14:16:17 devstack sudo[147476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-3fb355d2-fdf1-418f-8d68-7d6d622e444e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-3fb355d2-fdf1-418f-8d68-7d6d622e444e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:18 devstack sudo[147476]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076" returned: 0 in 0.826s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-quobyte-3fb355d2-fdf1-418f-8d68-7d6d622e444e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:18 devstack sudo[147507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 1G Jun 23 14:16:18 devstack sudo[147507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-3fb355d2-fdf1-418f-8d68-7d6d622e444e" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52cb4d5-441f-4455-b8d0-85f75e6a3286]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:18 devstack sudo[147511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e Jun 23 14:16:18 devstack sudo[147511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[147507]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 1G" returned: 0 in 0.917s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca867f2f-ae90-4923-b065-de6a4634f076 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:19 devstack sudo[147548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca867f2f-ae90-4923-b065-de6a4634f076 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 Jun 23 14:16:19 devstack sudo[147548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[147511]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e" returned: 0 in 0.913s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:19 devstack sudo[147550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e Jun 23 14:16:19 devstack sudo[147550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[147550]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3fb355d2-fdf1-418f-8d68-7d6d622e444e" returned: 0 in 0.653s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-3fb355d2-fdf1-418f-8d68-7d6d622e444e" released by "delete_volume" :: held 1.620s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Created reservations ['9e9b6b6c-b480-4eb3-be0a-d848a69eba8a', '6dfc30e1-ffe9-490c-83d0-e6dcfc76184c', 'abae601a-181c-4a73-b3e0-affc0bdc49a1', '34c7720c-b451-4198-9ee5-736a3e885272'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:19 devstack sudo[147548]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca867f2f-ae90-4923-b065-de6a4634f076 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492" returned: 0 in 0.812s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 is being set with open permissions: ugo+rw Jun 23 14:16:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:19 devstack sudo[147580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 Jun 23 14:16:19 devstack sudo[147580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:20 devstack sudo[147582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:20 devstack sudo[147582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-0579c902-718f-460e-ab05-418d2567fce9-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-0579c902-718f-460e-ab05-418d2567fce9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-quobyte-0579c902-718f-460e-ab05-418d2567fce9" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-0579c902-718f-460e-ab05-418d2567fce9" acquired by "delete_volume" :: waited 0.014s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce356898-1205-4154-89b5-e5cdec4bba3e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:20 devstack sudo[147580]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492" returned: 0 in 0.713s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:20 devstack sudo[147603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 Jun 23 14:16:20 devstack sudo[147603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:20 devstack sudo[147609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info Jun 23 14:16:20 devstack sudo[147609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:20 devstack sudo[147582]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.772s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:20 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Deleted volume successfully. Jun 23 14:16:20 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4ac908e2-e40b-4454-8c07-fa74f127ee82 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-3fb355d2-fdf1-418f-8d68-7d6d622e444e-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:21 devstack sudo[147603]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9" returned: 0 in 0.857s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:21 devstack sudo[147636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9 Jun 23 14:16:21 devstack sudo[147636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:21 devstack sudo[147609]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info" returned: 0 in 0.799s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:21 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info is being set with open permissions: ugo+rw Jun 23 14:16:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:21 devstack sudo[147641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info Jun 23 14:16:21 devstack sudo[147641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:22 devstack sudo[147636]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-0579c902-718f-460e-ab05-418d2567fce9" returned: 0 in 0.678s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-0579c902-718f-460e-ab05-418d2567fce9" released by "delete_volume" :: held 1.580s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Created reservations ['fa7ebde1-3644-492b-90cd-bcfb9e3cd767', '6091ae12-739f-4fb9-a20c-6054fa29e295', 'ed13d34b-0f2f-46ef-9488-adfb9299f33b', '0e9acb6e-9c13-4642-8b15-cbead983ac51'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:22 devstack sudo[147641]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.info" returned: 0 in 0.685s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.853s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.304s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c5213d-4ebb-4498-900f-a969daa85706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0fa3431b314c1c8efc52e42b071065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:09Z,use_quota=True,user_id='f7bf9ed128ae4d4597742fe86075e4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(248a6da0-f977-4c0a-993c-2952f127c5e6),volume_type_id=248a6da0-f977-4c0a-993c-2952f127c5e6)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Creating volume 23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:22 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:22 devstack sudo[147666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 1073741824 Jun 23 14:16:22 devstack sudo[147666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ca859598-4098-422f-982d-8a3d3979ceb4 tempest-CreateVolumesFromSnapshotTest-648730264 None] Create snapshot completed successfully Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:22 devstack sudo[147671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:22 devstack sudo[147671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-3a195749-61d6-4a07-9199-a1c3801c5844-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-3a195749-61d6-4a07-9199-a1c3801c5844-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-quobyte-3a195749-61d6-4a07-9199-a1c3801c5844" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-3a195749-61d6-4a07-9199-a1c3801c5844" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d21f96-d6a7-4559-92a1-7069d29031d5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:23 devstack sudo[147694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 Jun 23 14:16:23 devstack sudo[147694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:23 devstack sudo[147671]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (ddb5b479-ff01-4505-8180-336ec0f6ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4c503e-475d-41f0-8b77-9aad025a01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.903s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Deleted volume successfully. Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4c503e-475d-41f0-8b77-9aad025a01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1605920744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b122b1-84ef-4940-ac08-f016fcae6bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:23Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581db2a9-cd0e-420a-9983-09b4755dc4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581db2a9-cd0e-420a-9983-09b4755dc4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c6891f-ed0c-4bfb-b037-cf624d9d6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c6891f-ed0c-4bfb-b037-cf624d9d6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b122b1-84ef-4940-ac08-f016fcae6bc3', 'volume_name': 'volume-92b122b1-84ef-4940-ac08-f016fcae6bc3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack sudo[147666]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2773c5c-3232-4c12-b1f7-24cd680e1fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2773c5c-3232-4c12-b1f7-24cd680e1fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db85546a-bb9c-45ac-9c61-7ee0aa3f3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume 92b122b1-84ef-4940-ac08-f016fcae6bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b122b1-84ef-4940-ac08-f016fcae6bc3', 'volume_size': 1} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 1073741824" returned: 0 in 1.127s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-15c41d2e-2e92-4880-9054-5bebb01c514d tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-0579c902-718f-460e-ab05-418d2567fce9-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:23 devstack sudo[147712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:23 devstack sudo[147712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (1cd41cf1-a342-40e0-bc4e-c7fdd7d70109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf542443-f2be-4023-b8ab-c6a42c1bb995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf542443-f2be-4023-b8ab-c6a42c1bb995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152525431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f823ce5-b9bc-4ff5-b625-01a30bef7fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:24Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bfe1ee-bb79-472b-a057-12f1e6c91814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bfe1ee-bb79-472b-a057-12f1e6c91814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1874155b-5ec4-4023-b27e-7c6ac781f24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1874155b-5ec4-4023-b27e-7c6ac781f24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f823ce5-b9bc-4ff5-b625-01a30bef7fdf', 'volume_name': 'volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dceecf7-915e-4a19-9c5a-9c2770830d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dceecf7-915e-4a19-9c5a-9c2770830d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6063dfb-fefd-4b1d-84d7-13a11d500a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume 2f823ce5-b9bc-4ff5-b625-01a30bef7fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf', 'volume_size': 1} Jun 23 14:16:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:24 devstack sudo[147694]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844" returned: 0 in 1.078s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:24 devstack sudo[147735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844 Jun 23 14:16:24 devstack sudo[147735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (16781ce8-58f2-4601-85fc-6d963c98a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb98d3fb-2ff4-47e0-90e5-fd00052f7ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb98d3fb-2ff4-47e0-90e5-fd00052f7ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706133316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e959f477-83e6-44d6-95d3-80d9030cb749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:24Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c00a51e-6cd0-46b3-9adc-1f559868b4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c00a51e-6cd0-46b3-9adc-1f559868b4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b84dc3e-b6cd-4cf9-9e2e-3f43d5eaf4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b84dc3e-b6cd-4cf9-9e2e-3f43d5eaf4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e959f477-83e6-44d6-95d3-80d9030cb749', 'volume_name': 'volume-e959f477-83e6-44d6-95d3-80d9030cb749', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e92cd4-4f57-4336-88f4-1e35d1dc8062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e92cd4-4f57-4336-88f4-1e35d1dc8062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d80dde-deb2-4ed4-afa5-43fdff502260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume e959f477-83e6-44d6-95d3-80d9030cb749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e959f477-83e6-44d6-95d3-80d9030cb749', 'volume_size': 1} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:24 devstack sudo[147712]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 0 in 0.857s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.114s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183469224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a22b3d-58fd-46ef-bccf-0012b668dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:13Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Creating volume 75a22b3d-58fd-46ef-bccf-0012b668dfed {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:24 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:24 devstack sudo[147747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed 1073741824 Jun 23 14:16:24 devstack sudo[147747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Attempting download of d6662522-7ad7-4f22-93d6-03f283059c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/d6662522-7ad7-4f22-93d6-03f283059c95', 'metadata': {}}])) to volume 23c5213d-4ebb-4498-900f-a969daa85706. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4534fe20-f437-46c9-8926-b234ec4a2fe6]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:24 devstack sudo[147753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl Jun 23 14:16:24 devstack sudo[147753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (d94ec3e6-825a-4d76-85db-cacc33104a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a7568e-cc14-46b6-a09b-28bc881b2728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a7568e-cc14-46b6-a09b-28bc881b2728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1290254669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:25Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d788e50-44c3-40b5-a4e7-e34b7f1f59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d788e50-44c3-40b5-a4e7-e34b7f1f59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8412ad-f3ba-49bd-9471-614eb836dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8412ad-f3ba-49bd-9471-614eb836dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f', 'volume_name': 'volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1cbd41-5282-447c-b7bc-391c89abd98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1cbd41-5282-447c-b7bc-391c89abd98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24436430-b122-4697-a987-dac2434f8f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:24 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f', 'volume_size': 1} Jun 23 14:16:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:25 devstack sudo[147735]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-3a195749-61d6-4a07-9199-a1c3801c5844" returned: 0 in 1.098s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-3a195749-61d6-4a07-9199-a1c3801c5844" released by "delete_volume" :: held 2.234s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (d2a26226-447a-47f8-9977-5272083149c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6827813-3a39-48a3-a8e6-f715a5f13984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6827813-3a39-48a3-a8e6-f715a5f13984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875404412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1964f9d9-fbea-402d-b7fa-ce963e37a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:25Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afd4473-154d-4219-9127-1cae44307c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afd4473-154d-4219-9127-1cae44307c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931361a5-342a-458a-87b1-12ac187c2d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931361a5-342a-458a-87b1-12ac187c2d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1964f9d9-fbea-402d-b7fa-ce963e37a678', 'volume_name': 'volume-1964f9d9-fbea-402d-b7fa-ce963e37a678', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8315cdca-0e0d-4a01-a0ed-9a59997deaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8315cdca-0e0d-4a01-a0ed-9a59997deaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85133fae-9e1c-4092-9092-c5756e17df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:25 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume 1964f9d9-fbea-402d-b7fa-ce963e37a678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1964f9d9-fbea-402d-b7fa-ce963e37a678', 'volume_size': 1} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Created reservations ['5ceca9e3-1b4e-4aaf-be77-c332e005c78a', 'fe833e1b-c580-4030-b2f2-632f8cdd266d', '42244bea-8c76-4f83-b2ca-68618878b710', '410b4f31-3918-4e76-9a95-9af5e7c2e86d'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:25 devstack sudo[147753]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl" returned: 0 in 0.969s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:25 devstack sudo[147792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:25 devstack sudo[147792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:25 devstack sudo[147747]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:25 devstack sudo[147793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl Jun 23 14:16:25 devstack sudo[147793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed 1073741824" returned: 0 in 1.298s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:25 devstack sudo[147802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed Jun 23 14:16:25 devstack sudo[147802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:26 devstack sudo[147792]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.749s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Deleted volume successfully. Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-ced30330-9263-485c-ad2e-d01dc8a647df-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d96bf3cd-3f04-4825-9104-717927bede13 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-3a195749-61d6-4a07-9199-a1c3801c5844-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-ced30330-9263-485c-ad2e-d01dc8a647df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-quobyte-ced30330-9263-485c-ad2e-d01dc8a647df" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-ced30330-9263-485c-ad2e-d01dc8a647df" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2471262-f171-4b5c-8d61-9c0f043ca762]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:26 devstack sudo[147793]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl" returned: 1 in 0.956s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6662522-7ad7-4f22-93d6-03f283059c95__14e54fl' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:26 devstack sudo[147802]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd451e74-76a8-402a-a56d-cffb21c969d8]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed" returned: 0 in 0.768s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.800s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279067825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bfbda3-b5f4-49b4-9313-b3a049d9814e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:13Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Creating volume 78bfbda3-b5f4-49b4-9313-b3a049d9814e {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:26 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e463b1f-c8c3-4b2a-85a4-d592dcca0de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a22b3d-58fd-46ef-bccf-0012b668dfed', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af13c90-d5ac-493b-b50a-f198817668c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:26 devstack sudo[147834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e 1073741824 Jun 23 14:16:26 devstack sudo[147834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:26 devstack sudo[147829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df Jun 23 14:16:26 devstack sudo[147829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:26 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume volume-75a22b3d-58fd-46ef-bccf-0012b668dfed (75a22b3d-58fd-46ef-bccf-0012b668dfed): created successfully Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af13c90-d5ac-493b-b50a-f198817668c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:26 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (463ecd83-abd3-45e2-af5b-13614732b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:26 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9eb19272-ffa2-4d38-b37a-9c81c6f11a74 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created volume successfully. Jun 23 14:16:26 devstack sudo[147833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD Jun 23 14:16:26 devstack sudo[147833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:27 devstack sudo[147829]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df" returned: 0 in 0.838s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:27 devstack sudo[147869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df Jun 23 14:16:27 devstack sudo[147869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:27 devstack sudo[147833]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:27 devstack sudo[147874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD Jun 23 14:16:27 devstack sudo[147874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:27 devstack sudo[147834]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e 1073741824" returned: 0 in 1.050s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:27 devstack sudo[147883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e Jun 23 14:16:27 devstack sudo[147883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:27 devstack sudo[147869]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ced30330-9263-485c-ad2e-d01dc8a647df" returned: 0 in 0.742s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-ced30330-9263-485c-ad2e-d01dc8a647df" released by "delete_volume" :: held 1.644s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Created reservations ['d8a25795-9f6a-4474-a1db-104f7cfc1091', 'd4c2b973-b9f8-41d1-8cb8-647eed2412c2', 'e05c8003-ca17-484f-aacc-bd99a29f5357', '5a698624-d858-4b68-b96d-b3cb31c38363'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:28 devstack sudo[147874]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD" returned: 1 in 0.841s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] d6662522-7ad7-4f22-93d6-03f283059c95 was raw, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:28 devstack sudo[147907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:28 devstack sudo[147907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:28 devstack sudo[147910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:28 devstack sudo[147910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:28 devstack sudo[147883]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e" returned: 0 in 0.781s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.155s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1011795635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:14Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Creating volume b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:28 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d0a62e-a894-4de8-964a-e437522b8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:28 devstack sudo[147918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 1073741824 Jun 23 14:16:28 devstack sudo[147918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b525daac-8aeb-43fc-84de-4efdf3a2ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:28 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e (78bfbda3-b5f4-49b4-9313-b3a049d9814e): created successfully Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b525daac-8aeb-43fc-84de-4efdf3a2ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (29f8dfbe-0b77-42a6-9e19-f5c4ac9234c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:28 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b15539e1-d0d2-4730-9364-504e650efa75 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created volume successfully. Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-9861d20f-5c07-4df5-a1bf-41c3a25bad28-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-9861d20f-5c07-4df5-a1bf-41c3a25bad28-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "cinder-quobyte-9861d20f-5c07-4df5-a1bf-41c3a25bad28" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-9861d20f-5c07-4df5-a1bf-41c3a25bad28" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed843a67-d0de-4658-a332-f6fb4c6b3d06]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:28 devstack sudo[147929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 Jun 23 14:16:28 devstack sudo[147929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:28 devstack sudo[147910]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.785s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:28 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:28 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Deleted volume successfully. Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-562bae9f-03ca-4399-b695-9fc82da20b14 tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-ced30330-9263-485c-ad2e-d01dc8a647df-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:29 devstack sudo[147907]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 0 in 1.007s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6662522-7ad7-4f22-93d6-03f283059c95_hib_f8rndevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:16:29 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:29 devstack sudo[147952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 1G Jun 23 14:16:29 devstack sudo[147952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:29 devstack sudo[147918]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 1073741824" returned: 0 in 1.208s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:29 devstack sudo[147971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 Jun 23 14:16:29 devstack sudo[147971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:29 devstack sudo[147929]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28" returned: 0 in 0.935s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:29 devstack sudo[147973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28 Jun 23 14:16:29 devstack sudo[147973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:30 devstack sudo[147952]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 1G" returned: 0 in 0.844s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf13dfd1-4c39-43ff-82ec-02879e0762da]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:30 devstack sudo[147993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:30 devstack sudo[147993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:30 devstack sudo[147971]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12" returned: 0 in 0.725s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.613s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-235381609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cba193-960c-4d58-afdf-f35786bd344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:15Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Creating volume f9cba193-960c-4d58-afdf-f35786bd344d {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:30 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:30 devstack sudo[148003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d 1073741824 Jun 23 14:16:30 devstack sudo[148003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1026701-7a4a-4f7d-b37c-c4f1a944d979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea3d66f-860e-42c1-a114-bc04216d130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 (b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12): created successfully Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea3d66f-860e-42c1-a114-bc04216d130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (bd86a6cc-40e3-41b8-a23b-e2114e2b3b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:30 devstack sudo[147973]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-9861d20f-5c07-4df5-a1bf-41c3a25bad28" returned: 0 in 0.817s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:30 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9033f3b3-e514-4966-9019-746af40aaea8 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created volume successfully. Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-quobyte-9861d20f-5c07-4df5-a1bf-41c3a25bad28" released by "delete_volume" :: held 1.834s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Created reservations ['0dbee4bb-6ee7-46ab-9aa7-4d132ec979f8', '5e77290a-48dc-4bef-9aeb-38b6e4524c5e', 'f410457f-4cfc-4381-bffe-90e67aae8fd1', '2f86dc4b-5a1f-4c9a-af33-c441f4f5977a'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:30 devstack sudo[148017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:30 devstack sudo[148017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:31 devstack sudo[147993]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 0 in 0.977s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:31 devstack sudo[148034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:31 devstack sudo[148034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:31 devstack sudo[148003]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d 1073741824" returned: 0 in 1.151s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:31 devstack sudo[148051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d Jun 23 14:16:31 devstack sudo[148051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:31 devstack sudo[148017]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.965s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Deleted volume successfully. Jun 23 14:16:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-69b93d1f-63be-41df-ac95-df943f9c432e tempest-CreateVolumesFromImageTest-156601761 None] Lock "cinder-9861d20f-5c07-4df5-a1bf-41c3a25bad28-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:32 devstack sudo[148034]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 1 in 1.045s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Downloaded image d6662522-7ad7-4f22-93d6-03f283059c95 ((None, [{'url': 'file:///opt/stack/data/glance/images/d6662522-7ad7-4f22-93d6-03f283059c95', 'metadata': {}}])) to volume 23c5213d-4ebb-4498-900f-a969daa85706 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Temporary image d6662522-7ad7-4f22-93d6-03f283059c95 for user f7bf9ed128ae4d4597742fe86075e4bd is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Marking volume 23c5213d-4ebb-4498-900f-a969daa85706 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Copying metadata from image d6662522-7ad7-4f22-93d6-03f283059c95 to 23c5213d-4ebb-4498-900f-a969daa85706. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Creating volume glance metadata for volume 23c5213d-4ebb-4498-900f-a969daa85706 backed by image d6662522-7ad7-4f22-93d6-03f283059c95 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5823a2899983471f7ecf2f65b0ca0344', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396a6e87-3fb8-4c20-8529-26261c57be21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c5213d-4ebb-4498-900f-a969daa85706', 'volume_size': 1, 'image_id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6662522-7ad7-4f22-93d6-03f283059c95', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5823a2899983471f7ecf2f65b0ca0344', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e0fa3431b314c1c8efc52e42b071065', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '866732c028f1c3fdd02bd8beb138d33b522471a0440442ec5da0c9d9acaab23890ddcde04c2b82ca23395ddf070e8ae3390c090c47c71ced2917f82ca990f7f3', 'id': 'd6662522-7ad7-4f22-93d6-03f283059c95', 'created_at': datetime.datetime(2026, 6, 23, 12, 16, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 16, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6662522-7ad7-4f22-93d6-03f283059c95/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16a5ff5-4fc7-4927-9bc8-dcd215f5b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Volume volume-23c5213d-4ebb-4498-900f-a969daa85706 (23c5213d-4ebb-4498-900f-a969daa85706): created successfully Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16a5ff5-4fc7-4927-9bc8-dcd215f5b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Flow 'volume_create_manager' (8718bd82-68a6-4f8c-8129-e00803af25fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5a9d446b-2755-49e4-8bc2-39c4e7247230 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Created volume successfully. Jun 23 14:16:32 devstack sudo[148051]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d" returned: 0 in 0.818s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.274s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129953926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84a1b2e-928c-40b0-8a53-241b559ab411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2049059798449aa2009e9c781eaf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:15Z,use_quota=True,user_id='71d95fdfeef7492093f0cae3a5c04790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Creating volume e84a1b2e-928c-40b0-8a53-241b559ab411 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:32 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:32 devstack sudo[148085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 1073741824 Jun 23 14:16:32 devstack sudo[148085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b95741-eeeb-49b9-9c5f-afaddf5b7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cba193-960c-4d58-afdf-f35786bd344d', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:32 devstack sudo[148086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:32 devstack sudo[148086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecb3874-6124-43e5-8982-94bd4aec5d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:32 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume volume-f9cba193-960c-4d58-afdf-f35786bd344d (f9cba193-960c-4d58-afdf-f35786bd344d): created successfully Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecb3874-6124-43e5-8982-94bd4aec5d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (17a06a21-2977-4363-89c4-4b7499b644ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:32 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b2527123-7aff-40ac-8c32-0e15f259e56b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created volume successfully. Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Acquiring lock "cinder-23c5213d-4ebb-4498-900f-a969daa85706-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "cinder-23c5213d-4ebb-4498-900f-a969daa85706-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Acquiring lock "cinder-quobyte-23c5213d-4ebb-4498-900f-a969daa85706" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "cinder-quobyte-23c5213d-4ebb-4498-900f-a969daa85706" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b317fa6b-dbd4-4cdb-b68b-3e1182656d08]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:33 devstack sudo[148105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:33 devstack sudo[148105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:33 devstack sudo[148086]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.878s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:16:33 devstack sudo[148085]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 1073741824" returned: 0 in 1.201s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:33 devstack sudo[148134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 Jun 23 14:16:33 devstack sudo[148134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:33 devstack sudo[148105]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 0 in 0.879s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:33 devstack sudo[148140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:33 devstack sudo[148140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:34 devstack sudo[148134]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411" returned: 0 in 0.705s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.004s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1605920744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b122b1-84ef-4940-ac08-f016fcae6bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:23Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating volume 92b122b1-84ef-4940-ac08-f016fcae6bc3 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:34 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2da7ac-d76b-4323-88e0-d73bf9f46414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84a1b2e-928c-40b0-8a53-241b559ab411', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:34 devstack sudo[148162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 1073741824 Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2562d4b-f216-42f7-8017-d0c435e0c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:34 devstack sudo[148162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Volume volume-e84a1b2e-928c-40b0-8a53-241b559ab411 (e84a1b2e-928c-40b0-8a53-241b559ab411): created successfully Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2562d4b-f216-42f7-8017-d0c435e0c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Flow 'volume_create_manager' (8df56cd4-195a-4261-8504-64c3cd1af182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:34 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-77db4b44-249f-46e1-9fcb-998a3c4f8a7e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created volume successfully. Jun 23 14:16:34 devstack sudo[148140]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 1 in 0.903s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:34 devstack sudo[148174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706 Jun 23 14:16:34 devstack sudo[148174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-e84a1b2e-928c-40b0-8a53-241b559ab411-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-e84a1b2e-928c-40b0-8a53-241b559ab411-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:34 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-quobyte-e84a1b2e-928c-40b0-8a53-241b559ab411" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-e84a1b2e-928c-40b0-8a53-241b559ab411" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bedc513-bab0-468f-8399-c986cad7e3b6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:35 devstack sudo[148188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 Jun 23 14:16:35 devstack sudo[148188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:35 devstack sudo[148174]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-23c5213d-4ebb-4498-900f-a969daa85706" returned: 0 in 0.877s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "cinder-quobyte-23c5213d-4ebb-4498-900f-a969daa85706" released by "delete_volume" :: held 2.767s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:35 devstack sudo[148162]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 1073741824" returned: 0 in 1.258s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Created reservations ['c806eed6-9369-4ab8-9a58-2b87826e141f', '00095637-74ee-449d-90d2-7c12ebfc6b00', 'af0b7f53-1617-48bf-9fcc-0df39ca8acc5', '0500193e-7962-4ea9-95b2-417dd0e9aff6'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:35 devstack sudo[148219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 Jun 23 14:16:35 devstack sudo[148219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:35 devstack sudo[148224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:35 devstack sudo[148224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:36 devstack sudo[148188]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411" returned: 0 in 1.204s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:36 devstack sudo[148241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411 Jun 23 14:16:36 devstack sudo[148241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:36 devstack sudo[148219]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3" returned: 0 in 1.001s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.364s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.040s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1152525431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f823ce5-b9bc-4ff5-b625-01a30bef7fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:24Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating volume 2f823ce5-b9bc-4ff5-b625-01a30bef7fdf {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:36 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:36 devstack sudo[148224]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db85546a-bb9c-45ac-9c61-7ee0aa3f3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b122b1-84ef-4940-ac08-f016fcae6bc3', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:36 devstack sudo[148260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf 1073741824 Jun 23 14:16:36 devstack sudo[148260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fb1127-121d-4929-8ed4-24c1b4c6bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.966s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Deleted volume successfully. Jun 23 14:16:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 (92b122b1-84ef-4940-ac08-f016fcae6bc3): created successfully Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fb1127-121d-4929-8ed4-24c1b4c6bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (ddb5b479-ff01-4505-8180-336ec0f6ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-252b0899-c032-4ead-acb6-176d381bf823 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created volume successfully. Jun 23 14:16:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ff7ebba8-e27d-4b7e-a904-ba570d541d03 tempest-VolumeAndVolumeTypeFromImageTest-53413538 None] Lock "cinder-23c5213d-4ebb-4498-900f-a969daa85706-delete_volume" released by "delete_volume" :: held 4.200s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:37 devstack sudo[148241]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e84a1b2e-928c-40b0-8a53-241b559ab411" returned: 0 in 1.105s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-e84a1b2e-928c-40b0-8a53-241b559ab411" released by "delete_volume" :: held 2.361s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created reservations ['674d2ec7-86f5-4445-a99a-21a92139488c', 'dcc912f5-a3eb-44aa-bf4e-26c2055e7a61', '0db87f9e-469b-47a2-9751-5046b8310cf2', '153be2fb-14ee-4070-96a6-1f50caa0ed94'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:37 devstack sudo[148289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:37 devstack sudo[148289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:38 devstack sudo[148260]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf 1073741824" returned: 0 in 1.368s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:38 devstack sudo[148311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf Jun 23 14:16:38 devstack sudo[148311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-f9cba193-960c-4d58-afdf-f35786bd344d-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-f9cba193-960c-4d58-afdf-f35786bd344d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:38 devstack sudo[148289]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.955s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-quobyte-f9cba193-960c-4d58-afdf-f35786bd344d" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:38 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Deleted volume successfully. Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-f9cba193-960c-4d58-afdf-f35786bd344d" acquired by "delete_volume" :: waited 0.030s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-726015a4-343a-4380-a0b2-1cc3bc86292e tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-e84a1b2e-928c-40b0-8a53-241b559ab411-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c8671f-f949-40de-8e61-8274cd54243b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:38 devstack sudo[148328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d Jun 23 14:16:38 devstack sudo[148328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:39 devstack sudo[148311]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf" returned: 0 in 1.069s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.526s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.062s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706133316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e959f477-83e6-44d6-95d3-80d9030cb749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:24Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating volume e959f477-83e6-44d6-95d3-80d9030cb749 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:39 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6063dfb-fefd-4b1d-84d7-13a11d500a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:39 devstack sudo[148350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 1073741824 Jun 23 14:16:39 devstack sudo[148350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b09465f-20e3-4259-84ed-f7bb124fe6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:39 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf (2f823ce5-b9bc-4ff5-b625-01a30bef7fdf): created successfully Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b09465f-20e3-4259-84ed-f7bb124fe6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (1cd41cf1-a342-40e0-bc4e-c7fdd7d70109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1d87dfd3-60a6-44d5-a131-f727e73b9df6 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created volume successfully. Jun 23 14:16:39 devstack sudo[148328]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d" returned: 0 in 1.161s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:39 devstack sudo[148370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d Jun 23 14:16:39 devstack sudo[148370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:40 devstack sudo[148350]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 1073741824" returned: 0 in 1.418s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:40 devstack sudo[148407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 Jun 23 14:16:40 devstack sudo[148407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:40 devstack sudo[148370]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-f9cba193-960c-4d58-afdf-f35786bd344d" returned: 0 in 1.032s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:40 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-f9cba193-960c-4d58-afdf-f35786bd344d" released by "delete_volume" :: held 2.271s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:40 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created reservations ['491fb842-a964-49b6-a59f-69da3e64f204', '80a3b8a8-910a-45cd-a1b7-afaae52c201f', '77fc22d3-e972-49af-a7fe-e77289a6fda9', 'a3764672-24b8-45ac-92e6-2d66ad361321'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:41 devstack sudo[148415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:41 devstack sudo[148415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:41 devstack sudo[148407]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749" returned: 0 in 0.972s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.998s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1290254669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:25Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating volume b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:41 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:41 devstack sudo[148442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f 1073741824 Jun 23 14:16:41 devstack sudo[148442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d80dde-deb2-4ed4-afa5-43fdff502260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e959f477-83e6-44d6-95d3-80d9030cb749', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beff75a-380f-4f2e-aef3-78196c1ececa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:41 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume volume-e959f477-83e6-44d6-95d3-80d9030cb749 (e959f477-83e6-44d6-95d3-80d9030cb749): created successfully Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beff75a-380f-4f2e-aef3-78196c1ececa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (16781ce8-58f2-4601-85fc-6d963c98a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:41 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b2f44eed-8bed-41e4-820f-4690e4852297 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created volume successfully. Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-quobyte-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12" acquired by "delete_volume" :: waited 0.020s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[59862808-09f1-4f9d-b4dd-b43fe9469f5a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:42 devstack sudo[148415]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.146s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Deleted volume successfully. Jun 23 14:16:42 devstack sudo[148454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 Jun 23 14:16:42 devstack sudo[148454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-01843f13-7ce9-4f80-be1e-be3597168420 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-f9cba193-960c-4d58-afdf-f35786bd344d-delete_volume" released by "delete_volume" :: held 3.804s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:43 devstack sudo[148442]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f 1073741824" returned: 0 in 1.445s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:43 devstack sudo[148454]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12" returned: 0 in 1.144s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:43 devstack sudo[148497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12 Jun 23 14:16:43 devstack sudo[148497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Flow 'volume_create_manager' (f577ae6b-cc0a-484d-88b8-9bebcabb8120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4adc8e4-97f3-467e-b94f-68ab1ea0eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4adc8e4-97f3-467e-b94f-68ab1ea0eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422058433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715858df-59ee-4778-acb9-8e22d5c48fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7516c9a5f5401faefcfad0443aedc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:43Z,use_quota=True,user_id='78d7da133a4347b6b7be93ab0455a0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade777f7-4822-477d-b198-f76d9d893c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade777f7-4822-477d-b198-f76d9d893c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d88ebf-e3bb-48a8-9e2d-c4661f9eefc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:43 devstack sudo[148502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f Jun 23 14:16:43 devstack sudo[148502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d88ebf-e3bb-48a8-9e2d-c4661f9eefc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715858df-59ee-4778-acb9-8e22d5c48fcb', 'volume_name': 'volume-715858df-59ee-4778-acb9-8e22d5c48fcb', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3592d1-aa6b-414d-877f-8c3f4395367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3592d1-aa6b-414d-877f-8c3f4395367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae6e27d-fef3-4685-9fb6-031b00750ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:43 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Volume 715858df-59ee-4778-acb9-8e22d5c48fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715858df-59ee-4778-acb9-8e22d5c48fcb', 'volume_size': 1} Jun 23 14:16:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:44 devstack sudo[148497]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12" returned: 0 in 1.017s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12" released by "delete_volume" :: held 2.245s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:44 devstack sudo[148502]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f" returned: 0 in 0.975s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] <== create_volume: return (2581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.060s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875404412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1964f9d9-fbea-402d-b7fa-ce963e37a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1801b43e64f44b9c814c97f21b559194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:25Z,use_quota=True,user_id='125932b02d624aa0b19958dc04672761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Creating volume 1964f9d9-fbea-402d-b7fa-ce963e37a678 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:44 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created reservations ['f4de4f9c-c115-4ca7-ab13-0e066e6c0054', '5cb2c9d3-a22e-4bfd-8aaf-845926aadf54', '02aaf4c0-d036-4456-a031-fa803d3876d8', '61013a38-e690-4fb8-a15a-8392c1a02a02'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:44 devstack sudo[148536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 1073741824 Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24436430-b122-4697-a987-dac2434f8f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:44 devstack sudo[148536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952a1b50-53d1-4735-bb09-20974640c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:44 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f (b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f): created successfully Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952a1b50-53d1-4735-bb09-20974640c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (d94ec3e6-825a-4d76-85db-cacc33104a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:44 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ba65a3e9-95b6-4321-a16e-15827657b375 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created volume successfully. Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:44 devstack sudo[148544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:44 devstack sudo[148544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-78bfbda3-b5f4-49b4-9313-b3a049d9814e-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-78bfbda3-b5f4-49b4-9313-b3a049d9814e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-quobyte-78bfbda3-b5f4-49b4-9313-b3a049d9814e" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:45 devstack sudo[148544]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.985s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:45 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Deleted volume successfully. Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-78bfbda3-b5f4-49b4-9313-b3a049d9814e" acquired by "delete_volume" :: waited 0.053s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-4d4382d1-7c8d-4ae8-8c71-7c0b2d3dc24b tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-b9e1bc65-14d8-4e41-9e0d-52f62d0bfc12-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[187e2c28-1397-41ff-82da-76093bac1db5]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:45 devstack sudo[148536]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 1073741824" returned: 0 in 1.297s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:45 devstack sudo[148590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 Jun 23 14:16:45 devstack sudo[148590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:45 devstack sudo[148586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e Jun 23 14:16:45 devstack sudo[148586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:46 devstack sudo[148590]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678" returned: 0 in 1.107s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.411s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422058433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715858df-59ee-4778-acb9-8e22d5c48fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7516c9a5f5401faefcfad0443aedc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:43Z,use_quota=True,user_id='78d7da133a4347b6b7be93ab0455a0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Creating volume 715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:46 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85133fae-9e1c-4092-9092-c5756e17df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1964f9d9-fbea-402d-b7fa-ce963e37a678', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:46 devstack sudo[148664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb 1073741824 Jun 23 14:16:46 devstack sudo[148664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f7dffe-25f9-4afd-be36-dd26f2be6890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:46 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Volume volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 (1964f9d9-fbea-402d-b7fa-ce963e37a678): created successfully Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f7dffe-25f9-4afd-be36-dd26f2be6890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:46 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Flow 'volume_create_manager' (d2a26226-447a-47f8-9977-5272083149c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:46 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b74a2ef9-88de-46ef-b834-4e9b1e7e4b0a tempest-CreateVolumesFromSnapshotTest-648730264 None] Created volume successfully. Jun 23 14:16:47 devstack sudo[148586]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e" returned: 0 in 1.424s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:47 devstack sudo[148672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e Jun 23 14:16:47 devstack sudo[148672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-1964f9d9-fbea-402d-b7fa-ce963e37a678-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-1964f9d9-fbea-402d-b7fa-ce963e37a678-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-1964f9d9-fbea-402d-b7fa-ce963e37a678" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-1964f9d9-fbea-402d-b7fa-ce963e37a678" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3babde2-13a6-4c46-9c50-7a6829e9da5e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:47 devstack sudo[148699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 Jun 23 14:16:47 devstack sudo[148699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:48 devstack sudo[148672]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-78bfbda3-b5f4-49b4-9313-b3a049d9814e" returned: 0 in 0.998s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-78bfbda3-b5f4-49b4-9313-b3a049d9814e" released by "delete_volume" :: held 2.516s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:48 devstack sudo[148664]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb 1073741824" returned: 0 in 1.240s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created reservations ['b1d937f5-160a-4ffd-865c-f462d91130f5', '91874df8-c2b3-4954-9975-d160e05ef42f', '8541570e-2513-4e61-9be8-55b5cc9803f2', 'f194bbe5-9f35-49b6-8430-e252b90ba2bd'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:48 devstack sudo[148717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:16:48 devstack sudo[148717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:48 devstack sudo[148722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:48 devstack sudo[148722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:48 devstack sudo[148699]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678" returned: 0 in 1.009s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:48 devstack sudo[148742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678 Jun 23 14:16:48 devstack sudo[148742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:48 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-75a22b3d-58fd-46ef-bccf-0012b668dfed-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-75a22b3d-58fd-46ef-bccf-0012b668dfed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-quobyte-75a22b3d-58fd-46ef-bccf-0012b668dfed" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:49 devstack sudo[148717]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 0.915s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-75a22b3d-58fd-46ef-bccf-0012b668dfed" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae6e27d-fef3-4685-9fb6-031b00750ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715858df-59ee-4778-acb9-8e22d5c48fcb', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b7998a-d150-48e6-9385-16e14d323184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:49 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Volume volume-715858df-59ee-4778-acb9-8e22d5c48fcb (715858df-59ee-4778-acb9-8e22d5c48fcb): created successfully Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b7998a-d150-48e6-9385-16e14d323184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Flow 'volume_create_manager' (f577ae6b-cc0a-484d-88b8-9bebcabb8120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[af378b44-53b8-48ba-9945-410676dd1468]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:49 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-42f55a3b-5e9f-46eb-bc45-6ca6fa641655 tempest-VolumeDependencyTests-1348667160 None] Created volume successfully. Jun 23 14:16:49 devstack sudo[148757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed Jun 23 14:16:49 devstack sudo[148757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:49 devstack sudo[148722]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.181s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:49 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Deleted volume successfully. Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-33e837d8-1d05-4803-84ac-c0a1469b5c26 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-78bfbda3-b5f4-49b4-9313-b3a049d9814e-delete_volume" released by "delete_volume" :: held 4.083s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:49 devstack sudo[148742]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1964f9d9-fbea-402d-b7fa-ce963e37a678" returned: 0 in 1.102s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-1964f9d9-fbea-402d-b7fa-ce963e37a678" released by "delete_volume" :: held 2.196s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['b454b411-a407-46c0-aaa2-b964f32e9932', '604a60f3-36ba-4870-9f28-dcf87495f667', '2625b59d-5e92-4bc7-9af6-cd898205a5f5', '08fcf961-01d8-4afb-9163-97b7697e0809'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:50 devstack sudo[148793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:50 devstack sudo[148793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:50 devstack sudo[148757]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed" returned: 0 in 1.137s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:50 devstack sudo[148803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed Jun 23 14:16:50 devstack sudo[148803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Creating offline snapshot 566ca227-1691-4e0e-9169-02e3ea9485d2 of volume 715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d138c-b2a1-4d40-a180-e02768a28a8c]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:50 devstack sudo[148809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:16:50 devstack sudo[148809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:51 devstack sudo[148793]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.905s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:51 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleted volume successfully. Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166d7dd-e279-4314-9157-d395c26e8a7b tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-1964f9d9-fbea-402d-b7fa-ce963e37a678-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[627512ed-9d98-488f-8eb5-b2179764688e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:51 devstack sudo[148803]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-75a22b3d-58fd-46ef-bccf-0012b668dfed" returned: 0 in 0.902s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-75a22b3d-58fd-46ef-bccf-0012b668dfed" released by "delete_volume" :: held 2.169s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:51 devstack sudo[148834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f Jun 23 14:16:51 devstack sudo[148834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created reservations ['00412804-88c7-45c7-9dae-78d479170558', 'ab5dc68b-a5ba-4403-b2eb-f23a59cad845', 'b06b117e-34ee-47e1-bcc0-17e4d8d66ebc', 'c12111ae-c0ad-4109-9a15-895e3095a871'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:51 devstack sudo[148848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:51 devstack sudo[148848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:51 devstack sudo[148809]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 1.222s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:51 devstack sudo[148856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 1G Jun 23 14:16:51 devstack sudo[148856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:52 devstack sudo[148834]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f" returned: 0 in 1.126s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:52 devstack sudo[148880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f Jun 23 14:16:52 devstack sudo[148880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:52 devstack sudo[148848]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.871s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:52 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Deleted volume successfully. Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-78c07003-3e39-4078-90af-1037711dd771 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-75a22b3d-58fd-46ef-bccf-0012b668dfed-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-850265f3-9d03-4c2e-8cd4-86da0fa4cc50-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-850265f3-9d03-4c2e-8cd4-86da0fa4cc50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "cinder-quobyte-850265f3-9d03-4c2e-8cd4-86da0fa4cc50" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-850265f3-9d03-4c2e-8cd4-86da0fa4cc50" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd85fa-c924-4ff7-b6d7-cf55c2cc25dc]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:52 devstack sudo[148898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 Jun 23 14:16:52 devstack sudo[148898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:52 devstack sudo[148856]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 1G" returned: 0 in 1.190s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715858df-59ee-4778-acb9-8e22d5c48fcb -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:52 devstack sudo[148906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715858df-59ee-4778-acb9-8e22d5c48fcb -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 Jun 23 14:16:52 devstack sudo[148906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:53 devstack sudo[148880]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f" returned: 0 in 0.997s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f" released by "delete_volume" :: held 2.179s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['df67123f-bf81-497f-bb42-8021a21101bf', 'cb5a2634-437c-47d1-816a-4fd3884d3286', 'b338251d-a2ec-4c39-a640-c360aa70a997', '2b98360e-b016-4c3f-977d-5beb9eb3e2a5'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:53 devstack sudo[148927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:53 devstack sudo[148927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:53 devstack sudo[148898]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50" returned: 0 in 1.061s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:53 devstack sudo[148942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50 Jun 23 14:16:53 devstack sudo[148942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:53 devstack sudo[148906]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715858df-59ee-4778-acb9-8e22d5c48fcb -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2" returned: 0 in 1.058s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:53 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 is being set with open permissions: ugo+rw Jun 23 14:16:53 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:53 devstack sudo[148950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 Jun 23 14:16:53 devstack sudo[148950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-e959f477-83e6-44d6-95d3-80d9030cb749-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-e959f477-83e6-44d6-95d3-80d9030cb749-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-e959f477-83e6-44d6-95d3-80d9030cb749" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-e959f477-83e6-44d6-95d3-80d9030cb749" acquired by "delete_volume" :: waited 0.035s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:54 devstack sudo[148942]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-850265f3-9d03-4c2e-8cd4-86da0fa4cc50" returned: 0 in 0.865s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a6a30-6d15-47e9-8a3d-ef8148aa198a]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:54 devstack sudo[148927]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-quobyte-850265f3-9d03-4c2e-8cd4-86da0fa4cc50" released by "delete_volume" :: held 1.987s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.151s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:54 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleted volume successfully. Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-eb485426-7b19-4c96-b5b7-38448a51c96e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-b378130b-d76d-4b2a-aefa-8c4b6f5e3f8f-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Created reservations ['2fb05edf-6f0f-4306-b836-2a0d00914883', 'ee336c44-b7c8-4b80-9e23-21c69679abcd', 'd34fbfd0-33fb-4e56-8232-cbd9caf92b81', '8e4feb30-077b-4158-9bf6-60b2a6ce5906'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:54 devstack sudo[148975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 Jun 23 14:16:54 devstack sudo[148975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:54 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:54 devstack sudo[148984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:54 devstack sudo[148984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:55 devstack sudo[148950]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2" returned: 0 in 1.095s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:55 devstack sudo[148995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info Jun 23 14:16:55 devstack sudo[148995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:55 devstack sudo[148975]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749" returned: 0 in 1.089s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:55 devstack sudo[149019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749 Jun 23 14:16:55 devstack sudo[149019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:55 devstack sudo[148984]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:55 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.080s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:55 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:55 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Deleted volume successfully. Jun 23 14:16:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-28adb6d8-24d6-495d-96b4-a90204539412 tempest-CreateVolumesFromSourceVolumeTest-904113197 None] Lock "cinder-850265f3-9d03-4c2e-8cd4-86da0fa4cc50-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:56 devstack sudo[148995]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info" returned: 0 in 1.014s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:56 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info is being set with open permissions: ugo+rw Jun 23 14:16:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:56 devstack sudo[149035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info Jun 23 14:16:56 devstack sudo[149035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:56 devstack sudo[149019]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:56 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-e959f477-83e6-44d6-95d3-80d9030cb749" returned: 0 in 1.157s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:56 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-e959f477-83e6-44d6-95d3-80d9030cb749" released by "delete_volume" :: held 2.312s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:56 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['f0db6d91-8dff-4014-a589-104b27a71efb', '7bc5bee6-1c3f-4d22-87f8-450aef46e89f', '2447d1bc-85ec-4954-8e09-159ef5f56192', '6d1389e4-3c65-4e3b-ad39-b99f3b8657ff'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:57 devstack sudo[149067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:16:57 devstack sudo[149067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:57 devstack sudo[149035]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.info" returned: 0 in 1.031s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:57 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.773s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:57 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8afded7f-cea0-48f0-8e9b-6f40c12f9fac tempest-VolumeDependencyTests-1348667160 None] Create snapshot completed successfully Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:58 devstack sudo[149067]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.049s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:58 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleted volume successfully. Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-a64ccdd0-c064-4917-9262-1c4a1fdb0fc9 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-e959f477-83e6-44d6-95d3-80d9030cb749-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cbbaa4-4c78-4694-89ad-1dc294875db0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:58 devstack sudo[149105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf Jun 23 14:16:58 devstack sudo[149105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Flow 'volume_create_manager' (26ae34e5-1a30-4cb7-bace-42f8751d8489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b988ec-bb08-4e09-b716-4c516a53d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b988ec-bb08-4e09-b716-4c516a53d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1641990486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446ac89a-349c-4ff0-8a1d-02e9ef94a8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7516c9a5f5401faefcfad0443aedc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=566ca227-1691-4e0e-9169-02e3ea9485d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:59Z,use_quota=True,user_id='78d7da133a4347b6b7be93ab0455a0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259d4f56-d9bd-4a99-ad45-74c26bb07f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259d4f56-d9bd-4a99-ad45-74c26bb07f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb50657c-40f9-4af2-8182-c041b5747b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb50657c-40f9-4af2-8182-c041b5747b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '446ac89a-349c-4ff0-8a1d-02e9ef94a8f8', 'volume_name': 'volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8', 'volume_size': 1, 'snapshot_id': '566ca227-1691-4e0e-9169-02e3ea9485d2'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b763adeb-dec2-44f7-ad67-3f250c36ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b763adeb-dec2-44f7-ad67-3f250c36ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd4c561-a9f8-4b95-9ee4-d07f0e5d11f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:58 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Volume 446ac89a-349c-4ff0-8a1d-02e9ef94a8f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8', 'volume_size': 1, 'snapshot_id': '566ca227-1691-4e0e-9169-02e3ea9485d2'} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-quobyte-566ca227-1691-4e0e-9169-02e3ea9485d2-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-566ca227-1691-4e0e-9169-02e3ea9485d2-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Creating volume 446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 from snapshot 566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-quobyte-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] snapshot: 566ca227-1691-4e0e-9169-02e3ea9485d2, volume: 446ac89a-349c-4ff0-8a1d-02e9ef94a8f8, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:58 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:59 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a7239-d7b9-44ec-a94e-236a3cdab770]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:59 devstack sudo[149128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 Jun 23 14:16:59 devstack sudo[149128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:59 devstack sudo[149105]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf" returned: 0 in 1.186s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:59 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:59 devstack sudo[149148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf Jun 23 14:16:59 devstack sudo[149148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:00 devstack sudo[149128]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2" returned: 0 in 1.093s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715858df-59ee-4778-acb9-8e22d5c48fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6222a7-0b3b-4fac-987d-e58cd8e69524]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:00 devstack sudo[149172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:17:00 devstack sudo[149172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:00 devstack sudo[149148]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf" returned: 0 in 1.168s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf" released by "delete_volume" :: held 2.449s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:UPDATE=188,cinder:SELECT=124,cinder:DELETE=20,cinder:INSERT=45 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['d9a234c1-b1f9-4116-91dd-8903f5e58f76', '86a974d2-9e53-473d-a766-26331fb00c7d', 'c728bfa6-9de6-4b38-8d77-244659102a50', 'd9d13762-2ceb-4de4-8f75-6c11ae794f55'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:00 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:01 devstack sudo[149204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:01 devstack sudo[149204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:01 devstack sudo[149172]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 0.981s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:01 devstack sudo[149212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 Jun 23 14:17:01 devstack sudo[149212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-92b122b1-84ef-4940-ac08-f016fcae6bc3-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-92b122b1-84ef-4940-ac08-f016fcae6bc3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:SELECT=142,cinder:UPDATE=188,cinder:INSERT=48,cinder:DELETE=16 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-92b122b1-84ef-4940-ac08-f016fcae6bc3" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-92b122b1-84ef-4940-ac08-f016fcae6bc3" acquired by "delete_volume" :: waited 0.037s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[892622ab-a668-4663-98f8-b2c7c581d208]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:01 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:02 devstack sudo[149204]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:02 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.053s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:02 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:02 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleted volume successfully. Jun 23 14:17:02 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-22154b7d-3627-408f-b901-0ee612acb175 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-2f823ce5-b9bc-4ff5-b625-01a30bef7fdf-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:02 devstack sudo[149239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 Jun 23 14:17:02 devstack sudo[149239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:03 devstack sudo[149239]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3" returned: 0 in 2.018s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:03 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:04 devstack sudo[149315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3 Jun 23 14:17:04 devstack sudo[149315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Flow 'volume_create_manager' (6709a205-3af8-44f2-9e0e-c7787a77f82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc19e600-01ed-4dc7-8eff-770a484a477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc19e600-01ed-4dc7-8eff-770a484a477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fe8bb7-458c-4c80-9481-fa1f5a6eadf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7e4cf7102046049866691a2e9f1951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:05Z,use_quota=True,user_id='292449b44ad04b31a9e9309c8fc5f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176f1514-1298-4438-8e0a-2e4027a7def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176f1514-1298-4438-8e0a-2e4027a7def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcb121e-8875-43dc-a87f-9db95c0aed74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:05 devstack cinder-volume[93689]: DEBUG cinder.image.glance [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Creating Keystone auth plugin from conf {{(pid=93689) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:17:06 devstack sudo[149315]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-92b122b1-84ef-4940-ac08-f016fcae6bc3" returned: 0 in 2.168s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-92b122b1-84ef-4940-ac08-f016fcae6bc3" released by "delete_volume" :: held 4.277s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['86e98ae4-c54b-4a27-bb2d-5c10cf4012b7', 'c3c9e2e6-959f-453e-a19b-60b60367709d', '86f0e3f2-2e2d-42a3-829d-9631f61c4c6b', 'a815aada-774d-4e50-af7e-bf5b8223e18e'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcb121e-8875-43dc-a87f-9db95c0aed74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36fe8bb7-458c-4c80-9481-fa1f5a6eadf7', 'volume_name': 'volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7', 'volume_size': 1, 'image_id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b4b7f56d7d4c95ecc314a37244bad568', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e7e4cf7102046049866691a2e9f1951', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2638202dd688acd8f6f844218efb2fa22e96fdd8d924ebeca6f09099dc516e4e6941eaad8a028f5bb058d7887130ae8c560fff2863f01b09cfcca74b61df63ba', 'id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'created_at': datetime.datetime(2026, 6, 23, 12, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 17, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4/file', 'properties': {}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920d825f-0ef1-47ac-9482-0600c3020589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920d825f-0ef1-47ac-9482-0600c3020589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752495cd-3051-4665-80da-84f35696ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:06 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Volume 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7', 'volume_size': 1, 'image_id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b4b7f56d7d4c95ecc314a37244bad568', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e7e4cf7102046049866691a2e9f1951', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2638202dd688acd8f6f844218efb2fa22e96fdd8d924ebeca6f09099dc516e4e6941eaad8a028f5bb058d7887130ae8c560fff2863f01b09cfcca74b61df63ba', 'id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'created_at': datetime.datetime(2026, 6, 23, 12, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 17, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4/file', 'properties': {}}, 'image_service': } Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Trying to clone 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 from image 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'metadata': {}}]). {{(pid=93689) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:06 devstack sudo[149412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:06 devstack sudo[149412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:06 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:17:06 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:17:07 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f80db3-5aef-4074-acb9-2db370bd8ac6]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:07 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:07 devstack sudo[149423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD Jun 23 14:17:07 devstack sudo[149423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-275cf056-5d13-44be-a8eb-515eccf13492-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-275cf056-5d13-44be-a8eb-515eccf13492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-ca867f2f-ae90-4923-b065-de6a4634f076" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-ca867f2f-ae90-4923-b065-de6a4634f076" acquired by "delete_snapshot" :: waited 0.062s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-275cf056-5d13-44be-a8eb-515eccf13492" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-275cf056-5d13-44be-a8eb-515eccf13492" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleting offline snapshot 275cf056-5d13-44be-a8eb-515eccf13492 of volume ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] snapshot_file for this snap is: volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f9602-91d4-4eaa-afa1-d73d10cc7d25]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:08 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:08 devstack sudo[149463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 Jun 23 14:17:08 devstack sudo[149463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:09 devstack sudo[149412]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 2.165s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:09 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleted volume successfully. Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-12d32dd0-ad3f-48a9-9b7b-5efe53b2e374 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-92b122b1-84ef-4940-ac08-f016fcae6bc3-delete_volume" released by "delete_volume" :: held 7.327s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:09 devstack sudo[149212]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" returned: 0 in 8.111s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[abab9616-16df-4fe9-84b0-d9459c5aa46b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:09 devstack sudo[149423]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD" returned: 0 in 2.156s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:09 devstack sudo[149490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:17:09 devstack sudo[149490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:09 devstack sudo[149494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD Jun 23 14:17:09 devstack sudo[149494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:09 devstack sudo[149463]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492" returned: 0 in 1.375s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca867f2f-ae90-4923-b065-de6a4634f076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3faf5ff-a032-450a-a776-07dbb325e6be]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:09 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:09 devstack sudo[149515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 Jun 23 14:17:10 devstack sudo[149515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Flow 'volume_create_manager' (0177b563-5272-4b08-b56a-17204fff1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9126a4-cc5a-43aa-bd5c-264c951b3dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9126a4-cc5a-43aa-bd5c-264c951b3dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-269527050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27529c9d-e00c-4507-b89d-e09a71fbd44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699744aa4e0b45328cf1c214f17fcc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:10Z,use_quota=True,user_id='51bafec67ae748cbac70df4b318345f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4b8fc6-8ad6-438d-94e0-142b9737a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4b8fc6-8ad6-438d-94e0-142b9737a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4417847b-48d2-48e0-bbaf-1e52a6d18dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4417847b-48d2-48e0-bbaf-1e52a6d18dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27529c9d-e00c-4507-b89d-e09a71fbd44d', 'volume_name': 'volume-27529c9d-e00c-4507-b89d-e09a71fbd44d', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe411fa-9779-477a-96ea-a80cca8e9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe411fa-9779-477a-96ea-a80cca8e9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b73243-fdb1-439c-af15-66ad08e9b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:10 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Volume 27529c9d-e00c-4507-b89d-e09a71fbd44d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27529c9d-e00c-4507-b89d-e09a71fbd44d', 'volume_size': 1} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:10 devstack sudo[149494]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD" returned: 1 in 0.861s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Temporary image 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 is fetched for user 292449b44ad04b31a9e9309c8fc5f9ae. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a91e554-9c8b-4e7a-99eb-e28403ce6112]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:10 devstack sudo[149534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD Jun 23 14:17:10 devstack sudo[149534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:10 devstack sudo[149490]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 1.191s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:17:10 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Converted 1024.00 MB image at 126.23 MB/s Jun 23 14:17:10 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 is being set with open permissions: ugo+rw Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:10 devstack sudo[149543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 Jun 23 14:17:10 devstack sudo[149543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:10 devstack sudo[149515]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076" returned: 0 in 0.860s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:10 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:10 devstack sudo[149557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 Jun 23 14:17:10 devstack sudo[149557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:11 devstack sudo[149534]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:11 devstack sudo[149543]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" returned: 0 in 0.672s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" released by "_copy_volume_from_snapshot" :: held 12.183s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-566ca227-1691-4e0e-9169-02e3ea9485d2-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" released by "_create_volume_from_snapshot" :: held 12.225s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.243s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-269527050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27529c9d-e00c-4507-b89d-e09a71fbd44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699744aa4e0b45328cf1c214f17fcc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:10Z,use_quota=True,user_id='51bafec67ae748cbac70df4b318345f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Creating volume 27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:11 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:11 devstack sudo[149575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d 1073741824 Jun 23 14:17:11 devstack sudo[149575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd4c561-a9f8-4b95-9ee4-d07f0e5d11f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8', 'volume_size': 1, 'snapshot_id': '566ca227-1691-4e0e-9169-02e3ea9485d2'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:11 devstack sudo[149571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD Jun 23 14:17:11 devstack sudo[149571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff6f3aa-52c2-45f7-8e3d-737ec81830d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:11 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Volume volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 (446ac89a-349c-4ff0-8a1d-02e9ef94a8f8): created successfully Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff6f3aa-52c2-45f7-8e3d-737ec81830d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Flow 'volume_create_manager' (26ae34e5-1a30-4cb7-bace-42f8751d8489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:11 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b6173664-0e15-4858-af61-0e52f0cd69f0 tempest-VolumeDependencyTests-1348667160 None] Created volume successfully. Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-566ca227-1691-4e0e-9169-02e3ea9485d2-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-566ca227-1691-4e0e-9169-02e3ea9485d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-quobyte-715858df-59ee-4778-acb9-8e22d5c48fcb" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-715858df-59ee-4778-acb9-8e22d5c48fcb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-quobyte-566ca227-1691-4e0e-9169-02e3ea9485d2" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-566ca227-1691-4e0e-9169-02e3ea9485d2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Deleting offline snapshot 566ca227-1691-4e0e-9169-02e3ea9485d2 of volume 715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:17:11 devstack sudo[149557]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] snapshot_file for this snap is: volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492" returned: 0 in 0.872s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c8e5f-4a01-451f-b175-97af6a34a9b0]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:11 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:11 devstack sudo[149596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492 Jun 23 14:17:11 devstack sudo[149596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:11 devstack sudo[149597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 Jun 23 14:17:11 devstack sudo[149597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:12 devstack sudo[149571]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD" returned: 1 in 0.956s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:12 devstack sudo[149575]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d 1073741824" returned: 0 in 1.125s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:12 devstack sudo[149629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:12 devstack sudo[149629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:12 devstack sudo[149596]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076.275cf056-5d13-44be-a8eb-515eccf13492" returned: 0 in 0.815s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-275cf056-5d13-44be-a8eb-515eccf13492" released by "_delete_snapshot" :: held 4.141s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-ca867f2f-ae90-4923-b065-de6a4634f076" released by "delete_snapshot" :: held 4.207s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:12 devstack sudo[149597]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2" returned: 0 in 0.897s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715858df-59ee-4778-acb9-8e22d5c48fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9863617-3ad1-42db-9f3a-07f7afb27445]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['a5eb79da-ad40-4369-a023-c56f8651885c', '66e4327b-f2a5-43c2-a81a-9e96b41b6f91', '76f76ae9-2e50-4175-85a3-71bf50ddb8e5', '85b9d455-08fe-4821-862d-d740659f46e9'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:12 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Delete snapshot completed successfully. Jun 23 14:17:12 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b3b377d2-2979-47f7-9d54-a01f9f71a10e tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-275cf056-5d13-44be-a8eb-515eccf13492-delete_snapshot" released by "delete_snapshot" :: held 4.457s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:12 devstack sudo[149640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:17:12 devstack sudo[149640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:13 devstack sudo[149629]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 0.723s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fe8bb7-458c-4c80-9481-fa1f5a6eadf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7e4cf7102046049866691a2e9f1951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:05Z,use_quota=True,user_id='292449b44ad04b31a9e9309c8fc5f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Creating volume 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:13 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:13 devstack sudo[149658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 1073741824 Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b73243-fdb1-439c-af15-66ad08e9b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27529c9d-e00c-4507-b89d-e09a71fbd44d', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:13 devstack sudo[149658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41f0d34-3574-45b0-a201-0e8063351ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:13 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Volume volume-27529c9d-e00c-4507-b89d-e09a71fbd44d (27529c9d-e00c-4507-b89d-e09a71fbd44d): created successfully Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41f0d34-3574-45b0-a201-0e8063351ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Flow 'volume_create_manager' (0177b563-5272-4b08-b56a-17204fff1db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:13 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-68d73235-9a87-4466-8827-03b7664126d4 tempest-SnapshotDependencyTests-1662420307 None] Created volume successfully. Jun 23 14:17:13 devstack sudo[149640]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 0.814s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:13 devstack sudo[149672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 Jun 23 14:17:13 devstack sudo[149672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-ca867f2f-ae90-4923-b065-de6a4634f076-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-ca867f2f-ae90-4923-b065-de6a4634f076-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "cinder-quobyte-ca867f2f-ae90-4923-b065-de6a4634f076" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-ca867f2f-ae90-4923-b065-de6a4634f076" acquired by "delete_volume" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f95d3e5-f807-4e7b-9501-012b7a2e8947]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:13 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:13 devstack sudo[149687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 Jun 23 14:17:13 devstack sudo[149687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:14 devstack sudo[149658]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 1073741824" returned: 0 in 1.244s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:14 devstack sudo[149672]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:14 devstack sudo[149712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2" returned: 0 in 1.060s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:14 devstack sudo[149712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:14 devstack sudo[149717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2 Jun 23 14:17:14 devstack sudo[149717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:14 devstack sudo[149687]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076" returned: 0 in 1.107s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:14 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:14 devstack sudo[149734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076 Jun 23 14:17:14 devstack sudo[149734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:15 devstack sudo[149712]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 0 in 0.874s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.463s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Creating offline snapshot d79fa3ec-9b1a-4dc8-a906-787612bac109 of volume 27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Attempting download of 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'metadata': {}}])) to volume 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[8626a997-9534-4e28-953b-427f10949f82]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:15 devstack sudo[149717]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb.566ca227-1691-4e0e-9169-02e3ea9485d2" returned: 0 in 0.956s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0201d3e-771a-401f-af85-64f374efa3ca]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-566ca227-1691-4e0e-9169-02e3ea9485d2" released by "_delete_snapshot" :: held 3.902s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:15 devstack sudo[149752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:15 devstack sudo[149752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-715858df-59ee-4778-acb9-8e22d5c48fcb" released by "delete_snapshot" :: held 3.937s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:15 devstack sudo[149755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5 Jun 23 14:17:15 devstack sudo[149755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Created reservations ['b9f3c931-ad14-4ea9-9d41-45926226abc1', '7f28d8f0-0af1-4866-8d6a-e27dfc825eaf', '327ba4c2-92b8-4345-8549-cf171eacccc0', '507576eb-c598-4088-b791-c6ab61464cf8'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:15 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Delete snapshot completed successfully. Jun 23 14:17:15 devstack sudo[149734]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-b49f0991-f7a8-4b4b-a70c-c780e98a8d06 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-566ca227-1691-4e0e-9169-02e3ea9485d2-delete_snapshot" released by "delete_snapshot" :: held 4.153s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-ca867f2f-ae90-4923-b065-de6a4634f076" returned: 0 in 0.802s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-quobyte-ca867f2f-ae90-4923-b065-de6a4634f076" released by "delete_volume" :: held 1.994s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Created reservations ['1d50d85e-0146-42ec-bf45-ad1fc39c7917', '0736ee85-805a-4599-8cb3-00edf0c76d9d', '199a0ec4-f642-4142-87ef-f9c4e7d35390', '3d350e12-de03-4dd4-ba83-d048e0a23c60'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:15 devstack sudo[149774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:15 devstack sudo[149774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-715858df-59ee-4778-acb9-8e22d5c48fcb-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:15 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-715858df-59ee-4778-acb9-8e22d5c48fcb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-quobyte-715858df-59ee-4778-acb9-8e22d5c48fcb" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-715858df-59ee-4778-acb9-8e22d5c48fcb" acquired by "delete_volume" :: waited 0.025s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60226f-4bd5-41f7-a931-89030baaa601]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:16 devstack sudo[149752]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 1.081s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:16 devstack sudo[149785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:17:16 devstack sudo[149785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:16 devstack sudo[149797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 1G Jun 23 14:17:16 devstack sudo[149797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:16 devstack sudo[149755]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5" returned: 0 in 1.085s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:16 devstack sudo[149803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5 Jun 23 14:17:16 devstack sudo[149803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:16 devstack sudo[149774]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 1.079s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:16 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:16 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Deleted volume successfully. Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-ace4054d-069a-4e17-a783-cab6a94eb1e7 tempest-CreateVolumesFromSnapshotTest-648730264 None] Lock "cinder-ca867f2f-ae90-4923-b065-de6a4634f076-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:17 devstack sudo[149785]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 1.286s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:17 devstack sudo[149842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb Jun 23 14:17:17 devstack sudo[149842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:17 devstack sudo[149797]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:17 devstack sudo[149803]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5" returned: 1 in 1.246s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_txm9afd5' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 1G" returned: 0 in 1.331s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27529c9d-e00c-4507-b89d-e09a71fbd44d -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[199dbe46-87c8-427e-b628-228c492a2684]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:17 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:17 devstack sudo[149852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27529c9d-e00c-4507-b89d-e09a71fbd44d -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 Jun 23 14:17:17 devstack sudo[149852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:17 devstack sudo[149853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD Jun 23 14:17:17 devstack sudo[149853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:18 devstack sudo[149842]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-715858df-59ee-4778-acb9-8e22d5c48fcb" returned: 0 in 1.007s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-715858df-59ee-4778-acb9-8e22d5c48fcb" released by "delete_volume" :: held 2.402s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Created reservations ['5230c0ae-9c21-4ea6-a3a4-d08ff949cf0d', '2033f5a9-cab5-44a7-b73a-4df94276ddd2', '8c5c0905-2525-49a0-a6d2-5dd42ab4c97f', 'c321054b-1840-42ee-a1f1-4c9d07ebcb70'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:18 devstack sudo[149893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:18 devstack sudo[149893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:18 devstack sudo[149853]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD" returned: 0 in 1.017s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:18 devstack sudo[149852]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27529c9d-e00c-4507-b89d-e09a71fbd44d -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109" returned: 0 in 1.054s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:18 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 is being set with open permissions: ugo+rw Jun 23 14:17:18 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:18 devstack sudo[149899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 Jun 23 14:17:18 devstack sudo[149899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:18 devstack sudo[149897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD Jun 23 14:17:18 devstack sudo[149897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:19 devstack sudo[149893]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.768s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:19 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Deleted volume successfully. Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "cinder-quobyte-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9badbd99-8af3-4317-890a-bf731c481794 tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-715858df-59ee-4778-acb9-8e22d5c48fcb-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:19 devstack sudo[149899]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" acquired by "delete_volume" :: waited 0.021s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109" returned: 0 in 0.788s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8448eec-773e-44f6-92ac-afba491a19ae]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:19 devstack sudo[149897]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD" returned: 1 in 0.852s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 was raw, converting to raw {{(pid=93689) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:19 devstack sudo[149932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:19 devstack sudo[149932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:19 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:19 devstack sudo[149934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info Jun 23 14:17:19 devstack sudo[149934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:19 devstack sudo[149931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 Jun 23 14:17:19 devstack sudo[149931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:20 devstack sudo[149934]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:20 devstack sudo[149931]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" returned: 0 in 0.829s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:20 devstack sudo[149932]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 0 in 0.811s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info" returned: 0 in 0.780s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4_1v6eatowdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:17:20 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:20 devstack sudo[149968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8 Jun 23 14:17:20 devstack sudo[149968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:20 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info is being set with open permissions: ugo+rw Jun 23 14:17:20 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:20 devstack sudo[149969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 1G Jun 23 14:17:20 devstack sudo[149969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:20 devstack sudo[149971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info Jun 23 14:17:20 devstack sudo[149971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:21 devstack sudo[149971]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.info" returned: 0 in 0.667s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.883s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:21 devstack sudo[149969]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 1G" returned: 0 in 0.726s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:21 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-c7994f99-08e0-4621-8eca-d95a55884d3d tempest-SnapshotDependencyTests-1662420307 None] Create snapshot completed successfully Jun 23 14:17:21 devstack sudo[149968]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" returned: 0 in 0.785s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a6762f-7159-4694-ae5b-9348b26a074f]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-quobyte-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8" released by "delete_volume" :: held 1.673s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Created reservations ['7225f98e-8fcf-49dd-8551-6802dfff6140', 'b9a466ad-bbfd-4e2e-9945-8a900874b403', '88776859-81ff-44d0-8207-6ca5b9ff5bdd', '0318ccca-c9c2-45b6-a082-475ee2a8dc1f'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:21 devstack sudo[150003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:21 devstack sudo[150003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:21 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:21 devstack sudo[150009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:21 devstack sudo[150009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:22 devstack sudo[150003]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 0 in 0.847s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:22 devstack sudo[150009]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.788s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:22 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Deleted volume successfully. Jun 23 14:17:22 devstack sudo[150034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:22 devstack sudo[150034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-2f30bf87-e239-4d80-9951-091257bb20fd tempest-VolumeDependencyTests-1348667160 None] Lock "cinder-446ac89a-349c-4ff0-8a1d-02e9ef94a8f8-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Flow 'volume_create_manager' (eadc28bb-63b8-4c2a-ac40-b43b04dc50e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a4fa5a-7c7e-48d1-826d-114c01ec3214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a4fa5a-7c7e-48d1-826d-114c01ec3214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5336bb-767e-48ff-bd7d-329c497781d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='699744aa4e0b45328cf1c214f17fcc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d79fa3ec-9b1a-4dc8-a906-787612bac109,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:23Z,use_quota=True,user_id='51bafec67ae748cbac70df4b318345f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc5a24d-5e1d-4f4b-8e52-a3ce4ce2eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc5a24d-5e1d-4f4b-8e52-a3ce4ce2eede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d63155-59eb-4aec-8a12-c45ea92ac4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d63155-59eb-4aec-8a12-c45ea92ac4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b5336bb-767e-48ff-bd7d-329c497781d0', 'volume_name': 'volume-5b5336bb-767e-48ff-bd7d-329c497781d0', 'volume_size': 1, 'snapshot_id': 'd79fa3ec-9b1a-4dc8-a906-787612bac109'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105e43b1-9d21-453d-8c8c-f5968d5f4764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:22 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105e43b1-9d21-453d-8c8c-f5968d5f4764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea90e1f-885a-4464-8fed-5a2f16346565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Volume 5b5336bb-767e-48ff-bd7d-329c497781d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b5336bb-767e-48ff-bd7d-329c497781d0', 'volume_size': 1, 'snapshot_id': 'd79fa3ec-9b1a-4dc8-a906-787612bac109'} Jun 23 14:17:23 devstack sudo[150034]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-quobyte-d79fa3ec-9b1a-4dc8-a906-787612bac109-5b5336bb-767e-48ff-bd7d-329c497781d0" by "_create_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 1 in 0.959s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Downloaded image 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'metadata': {}}])) to volume 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 successfully. {{(pid=93689) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Temporary image 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 for user 292449b44ad04b31a9e9309c8fc5f9ae is deleted. {{(pid=93689) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.volume_utils [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Marking volume 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 as bootable. {{(pid=93689) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-d79fa3ec-9b1a-4dc8-a906-787612bac109-5b5336bb-767e-48ff-bd7d-329c497781d0" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Creating volume 5b5336bb-767e-48ff-bd7d-329c497781d0 from snapshot d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-quobyte-5b5336bb-767e-48ff-bd7d-329c497781d0" by "_copy_volume_from_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Copying metadata from image 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 to 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7. {{(pid=93689) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Creating volume glance metadata for volume 36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 backed by image 26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4 with: {'image_id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b4b7f56d7d4c95ecc314a37244bad568', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93689) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-5b5336bb-767e-48ff-bd7d-329c497781d0" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] snapshot: d79fa3ec-9b1a-4dc8-a906-787612bac109, volume: 5b5336bb-767e-48ff-bd7d-329c497781d0, {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d2aa0a-5473-4b30-9da6-7b30ffffdf80]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752495cd-3051-4665-80da-84f35696ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7', 'volume_size': 1, 'image_id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b4b7f56d7d4c95ecc314a37244bad568', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0e7e4cf7102046049866691a2e9f1951', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2638202dd688acd8f6f844218efb2fa22e96fdd8d924ebeca6f09099dc516e4e6941eaad8a028f5bb058d7887130ae8c560fff2863f01b09cfcca74b61df63ba', 'id': '26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4', 'created_at': datetime.datetime(2026, 6, 23, 12, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 17, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26ddbb3d-acf5-4f45-87bc-43fa53c8f2c4/file', 'properties': {}}, 'image_service': }' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b23290-13ba-47db-a531-0d015217a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:23 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Volume volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 (36fe8bb7-458c-4c80-9481-fa1f5a6eadf7): created successfully Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b23290-13ba-47db-a531-0d015217a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Flow 'volume_create_manager' (6709a205-3af8-44f2-9e0e-c7787a77f82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:23 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-59db2491-8357-45a2-bb4c-700644793ac4 tempest-VolumeImageDependencyTests-854831460 None] Created volume successfully. Jun 23 14:17:23 devstack sudo[150072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 Jun 23 14:17:23 devstack sudo[150072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:23 devstack sudo[150072]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109" returned: 0 in 0.831s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27529c9d-e00c-4507-b89d-e09a71fbd44d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Creating direct copy from snapshot {{(pid=93689) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[b479ee7e-f996-4e4d-a9e6-e845064bd614]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:23 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:24 devstack sudo[150101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:24 devstack sudo[150101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Acquiring lock "cinder-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Lock "cinder-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Acquiring lock "cinder-quobyte-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Lock "cinder-quobyte-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c5f3b-3575-4fd2-8a4b-9b669577f83d]: (4, 'raw') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:24 devstack sudo[150112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:24 devstack sudo[150112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:24 devstack sudo[150101]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 0.863s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG cinder.utils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Path /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 not found in is_blk_device check {{(pid=93689) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:17:24 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:24 devstack sudo[150135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 Jun 23 14:17:24 devstack sudo[150135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:25 devstack sudo[150112]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 0 in 0.805s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:25 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:25 devstack sudo[150145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:25 devstack sudo[150145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:26 devstack sudo[150145]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 1 in 1.191s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7' failed. Not Retrying. {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:17:26 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:26 devstack sudo[150198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7 Jun 23 14:17:26 devstack sudo[150198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:27 devstack sudo[150198]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:27 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" returned: 0 in 1.421s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:27 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Lock "cinder-quobyte-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7" released by "delete_volume" :: held 3.518s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Created reservations ['62dd8fcd-e957-4203-a812-001cfb4ec859', '801a88c7-b0cf-4970-b8a2-003ebedc52e7', '085c5a2f-c767-4b2c-bfa6-17a92b16aa1d', '624999d0-8899-4653-a8bc-f808acec0808'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:29 devstack sudo[150300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:29 devstack sudo[150300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:29 devstack sudo[150135]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0" returned: 0 in 5.063s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0d9112-3616-447b-a88f-fadb5a28cd62]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Flow 'volume_create_manager' (c2803561-a279-4147-bf94-9e5f9bd32257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:29 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8cdef7-0a00-4557-8c8f-401134e7f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8cdef7-0a00-4557-8c8f-401134e7f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1746b096-d2e0-47bd-8e96-bf540617519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6a8aed20724e779b177e13caa2d211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:30Z,use_quota=True,user_id='9b79930b42704a7caef2361e002a19c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bad573-90bd-4cf5-b17f-72ae61968a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bad573-90bd-4cf5-b17f-72ae61968a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0720aa7-fc7b-4900-b4dd-6fdce6135e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0720aa7-fc7b-4900-b4dd-6fdce6135e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1746b096-d2e0-47bd-8e96-bf540617519f', 'volume_name': 'volume-1746b096-d2e0-47bd-8e96-bf540617519f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ebf35f-5cf2-437f-9c20-175d3a733742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ebf35f-5cf2-437f-9c20-175d3a733742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e269d-63cf-417d-b4ec-4407d1bf687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Volume 1746b096-d2e0-47bd-8e96-bf540617519f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1746b096-d2e0-47bd-8e96-bf540617519f', 'volume_size': 1} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:30 devstack sudo[150311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:30 devstack sudo[150311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:30 devstack sudo[150300]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.803s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:30 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Deleted volume successfully. Jun 23 14:17:30 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-8afbc5d9-b852-4fff-bde8-eb41c23a143d tempest-VolumeImageDependencyTests-854831460 None] Lock "cinder-36fe8bb7-458c-4c80-9481-fa1f5a6eadf7-delete_volume" released by "delete_volume" :: held 6.318s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:31 devstack sudo[150311]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 1.085s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.image.image_utils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Image conversion details: src /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 {{(pid=93689) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:17:31 devstack cinder-volume[93689]: INFO cinder.image.image_utils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Converted 1024.00 MB image at 202.17 MB/s Jun 23 14:17:31 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 is being set with open permissions: ugo+rw Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:31 devstack sudo[150350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 Jun 23 14:17:31 devstack sudo[150350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:31 devstack sudo[150350]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0" returned: 0 in 0.752s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-5b5336bb-767e-48ff-bd7d-329c497781d0" released by "_copy_volume_from_snapshot" :: held 8.713s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-d79fa3ec-9b1a-4dc8-a906-787612bac109-5b5336bb-767e-48ff-bd7d-329c497781d0" released by "_create_volume_from_snapshot" :: held 8.751s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.775s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1746b096-d2e0-47bd-8e96-bf540617519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6a8aed20724e779b177e13caa2d211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:30Z,use_quota=True,user_id='9b79930b42704a7caef2361e002a19c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Creating volume 1746b096-d2e0-47bd-8e96-bf540617519f {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:31 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:31 devstack sudo[150377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f 1073741824 Jun 23 14:17:31 devstack sudo[150377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea90e1f-885a-4464-8fed-5a2f16346565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5336bb-767e-48ff-bd7d-329c497781d0', 'volume_size': 1, 'snapshot_id': 'd79fa3ec-9b1a-4dc8-a906-787612bac109'}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01d7daf-0e7e-4aea-8b26-80eb0ea1a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:31 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Volume volume-5b5336bb-767e-48ff-bd7d-329c497781d0 (5b5336bb-767e-48ff-bd7d-329c497781d0): created successfully Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01d7daf-0e7e-4aea-8b26-80eb0ea1a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:31 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Flow 'volume_create_manager' (eadc28bb-63b8-4c2a-ac40-b43b04dc50e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:31 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-d8ea99ff-b324-42b5-a546-7137ecd93505 tempest-SnapshotDependencyTests-1662420307 None] Created volume successfully. Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:32 devstack sudo[150399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:32 devstack sudo[150399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:32 devstack sudo[150377]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f 1073741824" returned: 0 in 0.851s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:32 devstack sudo[150413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f Jun 23 14:17:32 devstack sudo[150413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-d79fa3ec-9b1a-4dc8-a906-787612bac109-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-d79fa3ec-9b1a-4dc8-a906-787612bac109-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-quobyte-27529c9d-e00c-4507-b89d-e09a71fbd44d" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-27529c9d-e00c-4507-b89d-e09a71fbd44d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-quobyte-d79fa3ec-9b1a-4dc8-a906-787612bac109" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-d79fa3ec-9b1a-4dc8-a906-787612bac109" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:32 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Deleting offline snapshot d79fa3ec-9b1a-4dc8-a906-787612bac109 of volume 27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] snapshot_file for this snap is: volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53def1-e87d-47c8-8ac0-db980ab63d65]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:33 devstack sudo[150424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 Jun 23 14:17:33 devstack sudo[150424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:33 devstack sudo[150399]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.839s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_service.periodic_task [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] Running periodic task VolumeManager._thread_info {{(pid=93689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread count: 28 {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-9e1d8549-5eb9-456a-99b7-a983e281c5dd None None] thread info: [<_MainThread(MainThread, started 126697325113472)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:17:33 devstack sudo[150413]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f" returned: 0 in 0.779s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e269d-63cf-417d-b4ec-4407d1bf687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1746b096-d2e0-47bd-8e96-bf540617519f', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72471021-f8dc-4944-8779-14dbfa2d4f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:33 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Volume volume-1746b096-d2e0-47bd-8e96-bf540617519f (1746b096-d2e0-47bd-8e96-bf540617519f): created successfully Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72471021-f8dc-4944-8779-14dbfa2d4f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Flow 'volume_create_manager' (c2803561-a279-4147-bf94-9e5f9bd32257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:33 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-4e601c7b-bf29-45b9-91e0-4d0de3ee70f9 tempest-CinderUnicodeTest-1602815081 None] Created volume successfully. Jun 23 14:17:33 devstack sudo[150424]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109" returned: 0 in 0.853s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27529c9d-e00c-4507-b89d-e09a71fbd44d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab23ee-8357-4898-9f27-94d62895f81b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:33 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:34 devstack sudo[150458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:34 devstack sudo[150458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93689) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Flow 'volume_create_manager' (333e55f3-8481-437a-bcdd-f6446d100374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143017e6-d692-44a3-a369-d7e060d9aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143017e6-d692-44a3-a369-d7e060d9aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-985346516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2540d8-afb1-4806-b982-492546fdad95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6a8aed20724e779b177e13caa2d211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:35Z,use_quota=True,user_id='9b79930b42704a7caef2361e002a19c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd8c33a-74b7-4f83-ac2d-9554cc401e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd8c33a-74b7-4f83-ac2d-9554cc401e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee2ffcb-d26a-4255-abfe-141a57bbbeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee2ffcb-d26a-4255-abfe-141a57bbbeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2540d8-afb1-4806-b982-492546fdad95', 'volume_name': 'volume-8b2540d8-afb1-4806-b982-492546fdad95', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d768ba44-f9aa-4ebe-bb5c-a8c2fa1aba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d768ba44-f9aa-4ebe-bb5c-a8c2fa1aba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817b6806-17ce-42af-a102-8085e76e6aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:34 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Volume 8b2540d8-afb1-4806-b982-492546fdad95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2540d8-afb1-4806-b982-492546fdad95', 'volume_size': 1} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-985346516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2540d8-afb1-4806-b982-492546fdad95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6a8aed20724e779b177e13caa2d211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:35Z,use_quota=True,user_id='9b79930b42704a7caef2361e002a19c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fd97ccd-1315-4f4d-891b-df132dc1dd93),volume_type_id=7fd97ccd-1315-4f4d-891b-df132dc1dd93)}" {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Creating volume 8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Selected osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e as target Quobyte volume. {{(pid=93689) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:34 devstack cinder-volume[93689]: INFO cinder.volume.drivers.remotefs [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] casted to osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 1073741824 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:34 devstack sudo[150490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 1073741824 Jun 23 14:17:34 devstack sudo[150490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:34 devstack sudo[150458]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 1.006s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:34 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:34 devstack sudo[150495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 Jun 23 14:17:34 devstack sudo[150495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:35 devstack sudo[150495]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109" returned: 0 in 0.864s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:35 devstack sudo[150531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109 Jun 23 14:17:35 devstack sudo[150531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:35 devstack sudo[150490]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 1073741824" returned: 0 in 0.987s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:35 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:35 devstack sudo[150539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 Jun 23 14:17:35 devstack sudo[150539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:36 devstack sudo[150531]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d.d79fa3ec-9b1a-4dc8-a906-787612bac109" returned: 0 in 0.744s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-d79fa3ec-9b1a-4dc8-a906-787612bac109" released by "_delete_snapshot" :: held 3.585s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-27529c9d-e00c-4507-b89d-e09a71fbd44d" released by "delete_snapshot" :: held 3.619s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Created reservations ['2cee9ab0-4b10-4c70-b9e7-337ba1311bbc', '4406e794-4e1f-4990-8204-c168c101ee61', '735eb9d1-961e-410e-b07c-15db2b11393d', 'c880c5fb-8067-44b5-b7a7-8c1fafc9b8a4'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Delete snapshot completed successfully. Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1ed18d2c-6f14-49c9-91b0-fb1eb1704ff2 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-d79fa3ec-9b1a-4dc8-a906-787612bac109-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:36 devstack sudo[150539]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95" returned: 0 in 0.877s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'} {{(pid=93689) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817b6806-17ce-42af-a102-8085e76e6aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2540d8-afb1-4806-b982-492546fdad95', 'volume_size': 1}' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ab5a57-92a1-417a-bbab-8b3bbb5808b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:36 devstack cinder-volume[93689]: INFO cinder.volume.flows.manager.create_volume [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Volume volume-8b2540d8-afb1-4806-b982-492546fdad95 (8b2540d8-afb1-4806-b982-492546fdad95): created successfully Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ab5a57-92a1-417a-bbab-8b3bbb5808b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93689) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:36 devstack cinder-volume[93689]: DEBUG cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Flow 'volume_create_manager' (333e55f3-8481-437a-bcdd-f6446d100374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93689) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:36 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-bba184a1-ef1c-4b7f-ac43-e6f1d90cb305 tempest-CinderUnicodeTest-1602815081 None] Created volume successfully. Jun 23 14:17:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-27529c9d-e00c-4507-b89d-e09a71fbd44d-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-27529c9d-e00c-4507-b89d-e09a71fbd44d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-quobyte-27529c9d-e00c-4507-b89d-e09a71fbd44d" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:37 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-27529c9d-e00c-4507-b89d-e09a71fbd44d" acquired by "delete_volume" :: waited 0.018s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:37 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d002bf-c99c-4cbe-9a18-531defb6a86b]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:37 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:37 devstack sudo[150582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:37 devstack sudo[150582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:38 devstack sudo[150582]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 0.834s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:38 devstack sudo[150614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d Jun 23 14:17:38 devstack sudo[150614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Creating offline snapshot cd965e83-6f5b-420f-854f-1db8988c80ff of volume 8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b6816-1156-4556-9015-ca616e5b05d6]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:38 devstack sudo[150619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 Jun 23 14:17:38 devstack sudo[150619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:38 devstack sudo[150614]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-27529c9d-e00c-4507-b89d-e09a71fbd44d" returned: 0 in 0.655s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-27529c9d-e00c-4507-b89d-e09a71fbd44d" released by "delete_volume" :: held 1.548s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Created reservations ['7155a29a-6234-4866-a0b8-602e0fc02594', '2021e1ec-7b51-462f-a597-54f5b10b30e3', 'afde7fd8-46a4-41f8-b08b-3c1156ee562a', 'b9779ab5-fd16-4890-9f2a-d608f8e17f59'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:38 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:38 devstack sudo[150643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:38 devstack sudo[150643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:39 devstack sudo[150619]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95" returned: 0 in 0.872s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff 1G {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:39 devstack sudo[150654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff 1G Jun 23 14:17:39 devstack sudo[150654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-5b5336bb-767e-48ff-bd7d-329c497781d0-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-5b5336bb-767e-48ff-bd7d-329c497781d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "cinder-quobyte-5b5336bb-767e-48ff-bd7d-329c497781d0" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-5b5336bb-767e-48ff-bd7d-329c497781d0" acquired by "delete_volume" :: waited 0.019s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[d043a267-0d34-4cfb-baf1-f5acdd82a075]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:39 devstack sudo[150668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 Jun 23 14:17:39 devstack sudo[150668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:39 devstack sudo[150643]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.725s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:39 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Deleted volume successfully. Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-90d782b5-8ba7-41d0-b91c-56ca05eda175 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-27529c9d-e00c-4507-b89d-e09a71fbd44d-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:39 devstack sudo[150654]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff 1G" returned: 0 in 0.833s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:39 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2540d8-afb1-4806-b982-492546fdad95 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:39 devstack sudo[150686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2540d8-afb1-4806-b982-492546fdad95 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff Jun 23 14:17:39 devstack sudo[150686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:40 devstack sudo[150668]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0" returned: 0 in 0.894s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:40 devstack sudo[150707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0 Jun 23 14:17:40 devstack sudo[150707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:40 devstack sudo[150686]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2540d8-afb1-4806-b982-492546fdad95 -F qcow2 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff" returned: 0 in 0.733s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:40 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff is being set with open permissions: ugo+rw Jun 23 14:17:40 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:40 devstack sudo[150718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff Jun 23 14:17:40 devstack sudo[150718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:41 devstack sudo[150707]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-5b5336bb-767e-48ff-bd7d-329c497781d0" returned: 0 in 0.717s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-quobyte-5b5336bb-767e-48ff-bd7d-329c497781d0" released by "delete_volume" :: held 1.655s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Created reservations ['366b32ce-2e26-4e26-9c9e-0d2cf033257c', 'fa9660c3-69a7-44a1-8631-e5e6c8c1293c', 'f91ee408-cbe0-423a-a2f4-dec1040aded6', '8f78af8d-9e0e-4118-89ea-9250857a94b4'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:41 devstack sudo[150740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:41 devstack sudo[150740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:41 devstack sudo[150718]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff" returned: 0 in 0.668s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:41 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:41 devstack sudo[150745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info Jun 23 14:17:41 devstack sudo[150745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:42 devstack sudo[150740]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.718s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Deleted volume successfully. Jun 23 14:17:42 devstack sudo[150745]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-9ae1c32e-9904-42eb-9978-26de81879402 tempest-SnapshotDependencyTests-1662420307 None] Lock "cinder-5b5336bb-767e-48ff-bd7d-329c497781d0-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info" returned: 0 in 0.702s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:42 devstack cinder-volume[93689]: WARNING cinder.volume.drivers.remotefs [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info is being set with open permissions: ugo+rw Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:42 devstack sudo[150770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info Jun 23 14:17:42 devstack sudo[150770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:42 devstack sudo[150770]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.info" returned: 0 in 0.761s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:42 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.661s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:42 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-f27c8d00-4d56-4fec-b0e3-ac15f3779564 tempest-CinderUnicodeTest-1602815081 None] Create snapshot completed successfully Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-cd965e83-6f5b-420f-854f-1db8988c80ff-delete_snapshot" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-cd965e83-6f5b-420f-854f-1db8988c80ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-quobyte-8b2540d8-afb1-4806-b982-492546fdad95" by "delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-8b2540d8-afb1-4806-b982-492546fdad95" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-quobyte-cd965e83-6f5b-420f-854f-1db8988c80ff" by "_delete_snapshot" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-cd965e83-6f5b-420f-854f-1db8988c80ff" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Deleting offline snapshot cd965e83-6f5b-420f-854f-1db8988c80ff of volume 8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] snapshot_file for this snap is: volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff {{(pid=93689) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85d331-4714-40ab-a9ae-4bb09dd3561f]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:43 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:43 devstack sudo[150820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff Jun 23 14:17:43 devstack sudo[150820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:44 devstack sudo[150820]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff" returned: 0 in 0.831s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:44 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.remotefs [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2540d8-afb1-4806-b982-492546fdad95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93689) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:44 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6cee9f-bf64-4ee7-80c0-d7069a789825]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:44 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:44 devstack sudo[150852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 Jun 23 14:17:44 devstack sudo[150852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:45 devstack sudo[150852]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95" returned: 0 in 0.889s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:45 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:45 devstack sudo[150883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff Jun 23 14:17:45 devstack sudo[150883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:46 devstack sudo[150883]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff" returned: 0 in 0.900s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:46 devstack sudo[150917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff Jun 23 14:17:46 devstack sudo[150917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:46 devstack sudo[150917]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:46 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95.cd965e83-6f5b-420f-854f-1db8988c80ff" returned: 0 in 0.678s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-cd965e83-6f5b-420f-854f-1db8988c80ff" released by "_delete_snapshot" :: held 3.451s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:46 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-8b2540d8-afb1-4806-b982-492546fdad95" released by "delete_snapshot" :: held 3.473s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Created reservations ['7927b6a6-9ae5-478a-b069-8c46feda09f9', 'b7ae3318-2830-446b-a95a-6df981016aa6', '8c74b4cd-962d-4a97-bc84-6934c7650d38', '92230ee1-248e-43b5-b5a4-a3900b21cef7'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:47 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Delete snapshot completed successfully. Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-1c7bd0e9-a885-40b0-822a-da8f50e0749b tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-cd965e83-6f5b-420f-854f-1db8988c80ff-delete_snapshot" released by "delete_snapshot" :: held 3.651s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-8b2540d8-afb1-4806-b982-492546fdad95-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-8b2540d8-afb1-4806-b982-492546fdad95-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-quobyte-8b2540d8-afb1-4806-b982-492546fdad95" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-8b2540d8-afb1-4806-b982-492546fdad95" acquired by "delete_volume" :: waited 0.017s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[adede1ca-5f0e-497a-b23c-ed24567e0ac9]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:47 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:47 devstack sudo[151006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 Jun 23 14:17:47 devstack sudo[151006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:48 devstack sudo[151006]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95" returned: 0 in 0.858s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:48 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:48 devstack sudo[151038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95 Jun 23 14:17:48 devstack sudo[151038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:49 devstack sudo[151038]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-8b2540d8-afb1-4806-b982-492546fdad95" returned: 0 in 0.865s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-8b2540d8-afb1-4806-b982-492546fdad95" released by "delete_volume" :: held 1.841s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Created reservations ['11212aed-d652-400d-b655-3689c3ee1a9d', '6401a8e9-ea3d-4135-ac04-8527a12e3543', 'a8e0ae17-3761-4ed3-8532-5e3f6ae55c8d', '09f3a927-9aa0-4cda-bbbe-9e0186fcf9c1'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:49 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:49 devstack sudo[151073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:49 devstack sudo[151073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-1746b096-d2e0-47bd-8e96-bf540617519f-delete_volume" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-1746b096-d2e0-47bd-8e96-bf540617519f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "cinder-quobyte-1746b096-d2e0-47bd-8e96-bf540617519f" by "delete_volume" {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-1746b096-d2e0-47bd-8e96-bf540617519f" acquired by "delete_volume" :: waited 0.023s {{(pid=93689) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e0ae2-e75b-469b-9795-096bc7e9287e]: (4, 'qcow2') {{(pid=95307) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:50 devstack sudo[151090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f Jun 23 14:17:50 devstack sudo[151090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:50 devstack sudo[151073]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.877s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:50 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Deleted volume successfully. Jun 23 14:17:50 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-5166f950-f7d3-4460-b9cb-8cc0e746e08d tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-8b2540d8-afb1-4806-b982-492546fdad95-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:51 devstack sudo[151090]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f" returned: 0 in 0.943s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:51 devstack sudo[151123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f Jun 23 14:17:51 devstack sudo[151123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:51 devstack sudo[151123]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:51 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c/volume-1746b096-d2e0-47bd-8e96-bf540617519f" returned: 0 in 0.741s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:51 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-quobyte-1746b096-d2e0-47bd-8e96-bf540617519f" released by "delete_volume" :: held 1.743s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:51 devstack cinder-volume[93689]: DEBUG cinder.quota [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Created reservations ['39036ca9-05d8-4c33-8e4d-6a8a6e43c5e7', 'f3eb319a-116c-4217-b96b-bc181171ea38', 'b256ff28-4f20-4fbb-9511-c417ab117f1d', '542106ca-c2b1-4f85-befd-f330c29e1cf6'] {{(pid=93689) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e': None} {{(pid=93689) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG cinder.volume.drivers.quobyte [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d574aaff-aabd-4268-bfcb-95e81017e31e'] {{(pid=93689) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.lockutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93689) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:52 devstack sudo[151153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c Jun 23 14:17:52 devstack sudo[151153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:52 devstack sudo[151153]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG oslo_concurrency.processutils [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7458bc32ecc278da57234559a4d5d40c" returned: 0 in 0.747s {{(pid=93689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG cinder.manager [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Notifying Schedulers of capabilities ... {{(pid=93689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:52 devstack cinder-volume[93689]: INFO cinder.volume.manager [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Deleted volume successfully. Jun 23 14:17:52 devstack cinder-volume[93689]: DEBUG cinder.coordination [None req-54dc8c9c-8fbf-41f9-bed0-092b9dd3fc07 tempest-CinderUnicodeTest-1602815081 None] Lock "cinder-1746b096-d2e0-47bd-8e96-bf540617519f-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=93689) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:DELETE=8,cinder:SELECT=94,cinder:INSERT=33,cinder:UPDATE=110 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:18:02 devstack cinder-volume[93689]: DEBUG dbcounter [-] [93689] Writing DB stats cinder:INSERT=36,cinder:UPDATE=123,cinder:SELECT=88,cinder:DELETE=10 {{(pid=93689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}